00010000:00000010:3.1F:1705683279.216158:0:34:0:(ldlm_resource.c:1472:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff88006fa9cb00. 00010000:00000010:3.1:1705683279.216168:0:34:0:(ldlm_lock.c:198:lock_handle_free()) slab-freed 'lock': 560 at ffff88012f340000. 00010000:00000010:2.1F:1705683279.246187:0:34:0:(ldlm_resource.c:1472:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff88012fa2d700. 00010000:00000010:2.1:1705683279.246197:0:34:0:(ldlm_lock.c:198:lock_handle_free()) slab-freed 'lock': 560 at ffff88012f344780. 00010000:00000010:2.1:1705683279.252150:0:11:0:(ldlm_resource.c:1472:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff88006fa9cb00. 00010000:00000010:2.1:1705683279.252156:0:11:0:(ldlm_lock.c:198:lock_handle_free()) slab-freed 'lock': 560 at ffff88012effc000. 00080000:00000010:2.1:1705683279.252161:0:11:0:(osd_handler.c:1612:osd_oxc_free()) kfreed 'oxe': 68 at ffff88012b1dcd80. 00010000:00000010:3.1:1705683279.252214:0:27:0:(ldlm_lock.c:198:lock_handle_free()) slab-freed 'lock': 560 at ffff88012f340000. 00010000:00010000:2.0:1705683932.337342:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0eb200/0xefc4487a01805ef6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x865f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0f2c expref: 4112 pid: 14219 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.337353:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.337363:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4111:1857:x1788538640987392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.337368:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332632 00000100:00100000:2.0:1705683932.337393:0:6520:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a7300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6520:1788538584466688:192.168.203.41@tcp:105: 00010000:00010000:2.0:1705683932.337403:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.337412:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4109:1856:x1788538640985472:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 8733us (8800us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.337417:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332617 00010000:00010000:2.0:1705683932.337444:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0780/0xefc4487a01877a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337448:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0780/0xefc4487a01877a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337453:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0780/0xefc4487a01877a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337456:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0780/0xefc4487a01877a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337464:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1705683932.337541:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c3200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3022:3083:x1788538584466368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9211us (9229us total) trans 4295348020 rc 0/0 00000100:00100000:2.0:1705683932.337546:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920406 00010000:00010000:2.0:1705683932.337559:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.337573:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.337610:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.337644:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.337662:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337663:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337667:0:15131:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584468096 00000100:00100000:2.0:1705683932.337674:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337675:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337676:0:15131:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584468032 00000100:00100000:2.0:1705683932.337680:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337681:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337682:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920420 00000100:00100000:2.0:1705683932.337685:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3022:3082:x1788538584468096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.337692:0:15131:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34403 count 1 00010000:00010000:2.0:1705683932.337857:0:15131:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337863:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4107 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.337867:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801319d1180/0xefc4487a018597be lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8541 expref: 6062 pid: 15110 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.337870:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.337870:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.337871:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.337880:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801319d1180/0xefc4487a018597be lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8541 expref: 6062 pid: 15110 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.337887:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801319d1180/0xefc4487a018597be lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8541 expref: 6062 pid: 15110 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.337891:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a5000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584468224:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.337903:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4107 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.337907:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4107 pid: 15104 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.337910:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584468352:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.337915:0:15131:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009809c240 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.337923:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337923:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.337926:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920422 00000100:00100000:2.0:1705683932.337928:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea74600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3023:3084:x1788538584468160:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.337978:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9573:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.337980:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9573:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.337980:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9573:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.337981:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9573:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.337982:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9573:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.338004:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3025:3084:x1788538584468160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (301us total) trans 4295348022 rc 0/0 00000100:00100000:2.0:1705683932.338007:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920422 00000100:00100000:2.0:1705683932.338039:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338051:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338058:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338059:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338061:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584468480 00000100:00100000:2.0:1705683932.338068:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338069:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338070:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920424 00000100:00100000:2.0:1705683932.338072:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea72800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3025:3081:x1788538584468480:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.338121:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9574:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.338122:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9574:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.338123:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9574:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.338124:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9574:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.338125:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9574:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.338139:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea72800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3026:3081:x1788538584468480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 66us (92us total) trans 4295348024 rc 0/0 00000100:00100000:2.0:1705683932.338141:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920424 00000100:00100000:2.0:1705683932.338191:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338191:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338194:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332637 00000100:00100000:2.0:1705683932.338197:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a67a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4108:1857:x1788538640987648:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.338201:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.338202:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013222d680/0xefc4487a01805f19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0f4f expref: 4108 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.338207:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013222d680/0xefc4487a01805f19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0f4f expref: 4108 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.338214:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013222d680/0xefc4487a01805f19 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0f4f expref: 4108 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.338229:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.338229:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.338230:0:6520:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2f80/0xefc4487a01877ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8660:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338233:0:6520:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2f80/0xefc4487a01877ab0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x8660:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338244:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.338251:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a67a5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4108:1857:x1788538640987648:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.338253:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332637 00000100:00100000:2.0:1705683932.338259:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338259:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.338265:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.338267:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338270:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366ed00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.338271:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338274:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877a86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338279:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877a86 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338284:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877a86 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338291:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.338291:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.338292:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.338300:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ea70f00/2, rc 0, transno 380728 00000100:00100000:2.0:1705683932.338304:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009ea70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584468480:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.338308:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b03e400/2, rc 0, transno 380729 00000100:00100000:2.0:1705683932.338309:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007b03e400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584466880:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338328:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a4b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584468672:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338338:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.338344:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1705683932.338346:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a6900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584468608:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338352:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.338357:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338358:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338361:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584468672 00000100:00100000:2.0:1705683932.338367:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338368:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338369:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584468608 00000100:00100000:2.0:1705683932.338377:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338378:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338381:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920426 00000100:00100000:2.0:1705683932.338383:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a67a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3028:3084:x1788538584468672:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.338389:0:15118:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34406 count 1 00010000:00010000:2.0:1705683932.338527:0:15118:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338533:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013581b480/0xefc4487a01805feb lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1013 expref: 4105 pid: 15213 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.338537:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.338539:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.338540:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.338540:0:15118:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338548:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.338552:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.338556:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584468928:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.338566:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013581b480/0xefc4487a01805feb lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1013 expref: 4105 pid: 15213 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.338570:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013581b480/0xefc4487a01805feb lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1013 expref: 4105 pid: 15213 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.338573:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584469056:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.338577:0:15118:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801319e8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.338583:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.338584:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a01877ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338587:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366cf00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.338588:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a01877ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338591:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a01877ab7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338597:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a01877ab7 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338599:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a01877ab7 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338655:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.338656:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.338656:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.338664:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b03f800/2, rc 0, transno 380730 00000100:00100000:2.0:1705683932.338667:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007b03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584467200:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338681:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1705683932.338684:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584469248:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338699:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.338722:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338723:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338761:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.338765:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469440:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.338777:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.338810:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338837:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338861:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338885:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.338912:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338913:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.338919:0:14205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413323 00000100:00100000:2.0:1705683932.338922:0:14205:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880092c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1852:7302:x1788538640988096:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:2.0:1705683932.338940:0:14205:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.338949:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0112580/0xefc4487a01877a63 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300bf3 expref: 1852 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.338956:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:2.0:1705683932.338958:0:14205:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1705683932.338965:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d819b80/0xefc4487a01877b5f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x419f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:2.0:1705683932.338970:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d819b80/0xefc4487a01877b5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x419f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.338974:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d819b80/0xefc4487a01877b5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x419f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00000004:00010000:2.0:1705683932.339036:0:14205:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880092c5d500 reply state ffff88008f335000 transno 4295084914 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d819b80/0xefc4487a01877b5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x419f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.339044:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d819b80/0xefc4487a01877b5f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x419f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.339048:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:2.0:1705683932.339049:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00200000:2.0:1705683932.339053:0:14205:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x419f:0x0]: returning size 4096 00000100:00100000:2.0:1705683932.339072:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1853:7302:x1788538640988096:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 150us (297us total) trans 4295084914 rc 0/0 00000100:00100000:2.0:1705683932.339094:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413323 00000100:00100000:2.0:1705683932.339159:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000004:00080000:2.0:1705683932.339193:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b03d000/2, rc 0, transno 380736 00000100:00100000:2.0:1705683932.339197:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007b03d000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584467712:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.339337:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323dda00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469760:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.339351:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.339449:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801323dda00/2, rc 0, transno 380738 00000100:00100000:2.0:1705683932.339454:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323dda00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469760:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.339472:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.339476:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323ddf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469952:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.339489:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.339651:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.339761:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.339802:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.339803:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340704:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a5000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584468224:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.340720:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584468352:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.340730:0:15131:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.340737:0:15131:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.340737:0:15131:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.340738:0:15131:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340742:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340743:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340746:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640988736 00000100:00100000:2.0:1705683932.340757:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340758:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340759:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640988544 00000100:00100000:2.0:1705683932.340765:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340765:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.340767:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920439 00000100:00100000:2.0:1705683932.340769:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880092c5da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6061:6521:x1788538640988736:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.340773:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.340924:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d81a800/0xefc4487a01877bc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300c6a expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.340931:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.340937:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.340938:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.340940:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d81a800/0xefc4487a01877bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c6a expref: 6060 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.340945:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d81a800/0xefc4487a01877bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c6a expref: 6060 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.340949:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d81a800, rc 0) 00000100:00100000:2.0:1705683932.340959:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6060:6521:x1788538640988736:12345-192.168.203.41@tcp:101:dd.0 Request processed in 189us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.340964:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920439 00000100:00100000:2.0:1705683932.342210:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584468928:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.342217:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584469056:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.342229:0:15118:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.342235:0:15118:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.342236:0:15118:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.342237:0:15118:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.342244:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.342245:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.342249:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640989248 00000100:00100000:2.0:1705683932.342263:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.342263:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.342267:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920442 00000100:00100000:2.0:1705683932.342270:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880092c5ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4105:6554:x1788538640989248:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.342276:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.342303:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d819900/0xefc4487a01877beb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300c78 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.342315:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008daf0780/0xefc4487a01863393 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb140 expref: 4106 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.342320:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.342321:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.342323:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d819900/0xefc4487a01877beb lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c78 expref: 4106 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.342340:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008daf0780/0xefc4487a01863393 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb140 expref: 4106 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.342346:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008daf0780/0xefc4487a01863393 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb140 expref: 4106 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.342353:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584470272:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.342369:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008197ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.343081:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343083:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343088:0:15145:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640990400 00000100:00100000:2.0:1705683932.343107:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343108:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343113:0:15145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920443 00000100:00100000:2.0:1705683932.343116:0:15145:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880092c5f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4107:6496:x1788538640990400:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.343122:0:15145:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.343391:0:15145:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314e8a00/0xefc4487a01877c0e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x91fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300c86 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.343400:0:15145:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x91fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.343406:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.343407:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.343409:0:15145:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314e8a00/0xefc4487a01877c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x91fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c86 expref: 4108 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343414:0:15145:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314e8a00/0xefc4487a01877c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x91fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c86 expref: 4108 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343418:0:15145:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314e8a00, rc 0) 00000100:00100000:2.0:1705683932.343442:0:15145:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4108:6496:x1788538640990400:12345-192.168.203.41@tcp:101:dd.0 Request processed in 325us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.343446:0:15145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920443 00000100:00100000:2.0:1705683932.343664:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323d9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584470272:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.343672:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d819900/0xefc4487a01877beb lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9516:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c78 expref: 4107 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343678:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d819900, rc 0) 00000100:00100000:2.0:1705683932.343694:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4107:6554:x1788538640989248:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1422us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.343698:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920442 00000100:00100000:2.0:1705683932.343732:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343733:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343738:0:6520:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640989184 00010000:00010000:2.0:1705683932.343747:0:6520:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135844280/0xefc4487a01806023 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1060 expref: 4108 pid: 15213 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.343758:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343759:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343762:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332642 00000100:00100000:2.0:1705683932.343764:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880092c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4109:1856:x1788538640988928:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.343770:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.343772:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4109 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343780:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4109 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343786:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013222f200/0xefc4487a01805f90 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fb8 expref: 4109 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343794:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.343804:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880092c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4107:1856:x1788538640988928:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 40us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.343807:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332642 00000100:00100000:2.0:1705683932.343813:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343814:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.343816:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332645 00000100:00100000:2.0:1705683932.343817:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6060:1856:x1788538640989376:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.343820:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.343822:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343825:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343831:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a651c780/0xefc4487a018597e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f856b expref: 6060 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.343835:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.343841:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6059:1856:x1788538640989376:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 23us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.343843:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332645 00010000:00010000:2.0:1705683932.343912:0:15118:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343916:0:15118:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343919:0:15118:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343922:0:15118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a01877b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.343928:0:15118:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.344019:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a67a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3037:3084:x1788538584468672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5635us (5680us total) trans 4295348035 rc 0/0 00000100:00100000:2.0:1705683932.344023:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920426 00000100:00100000:2.0:1705683932.344114:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344115:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344118:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584470336 00000100:00100000:2.0:1705683932.344125:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344125:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344127:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920445 00000100:00100000:2.0:1705683932.344129:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3037:3081:x1788538584470336:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.344175:0:15118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x957a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.344176:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x957a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.344177:0:15118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x957a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.344178:0:15118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x957a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.344179:0:15118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x957a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.344194:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3038:3081:x1788538584470336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 64us (87us total) trans 4295348036 rc 0/0 00000100:00100000:2.0:1705683932.344197:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920445 00000100:00100000:2.0:1705683932.344336:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344337:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344339:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584470400 00000100:00100000:2.0:1705683932.344350:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344351:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344353:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920446 00000100:00100000:2.0:1705683932.344355:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3038:3082:x1788538584470400:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.344361:0:15118:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34411 count 1 00010000:00010000:2.0:1705683932.344500:0:15118:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344505:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b37f700/0xefc4487a0180608c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10c9 expref: 4101 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.344509:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7c280/0xefc4487a0185982e lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85b1 expref: 6055 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.344512:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.344512:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.344513:0:15118:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344521:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb7c280/0xefc4487a0185982e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85b1 expref: 6055 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.344528:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7c280/0xefc4487a0185982e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85b1 expref: 6055 pid: 14234 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.344532:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323d9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584470528:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.344554:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b37f700/0xefc4487a0180608c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10c9 expref: 4101 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.344558:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b37f700/0xefc4487a0180608c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10c9 expref: 4101 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.344562:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323de900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584470592:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.344568:0:15118:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801319e8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.344575:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.344577:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dfd1180/0xefc4487a01877b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344582:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009dfd1180 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.344583:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd1180/0xefc4487a01877b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344588:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd1180/0xefc4487a01877b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344595:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dfd1180/0xefc4487a01877b51 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344600:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dfd1180/0xefc4487a01877b51 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344611:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.344612:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.344613:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.344628:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801323dad00/2, rc 0, transno 380741 00000100:00100000:2.0:1705683932.344634:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469440:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.344645:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344646:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344650:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640989568 00010000:00010000:2.0:1705683932.344659:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801319d0a00/0xefc4487a01859819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85a3 expref: 6058 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.344667:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344668:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344670:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640989824 00010000:00010000:2.0:1705683932.344675:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135818280/0xefc4487a01805f97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8664:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d0fdb expref: 4105 pid: 14219 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.344681:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344682:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344684:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640990464 00010000:00010000:2.0:1705683932.344689:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a3d3700/0xefc4487a018478a9 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecbcf expref: 3435 pid: 15112 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.344695:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344696:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344698:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332653 00000100:00100000:2.0:1705683932.344702:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b03da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4105:1856:x1788538640988992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.344706:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.344717:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e964c80/0xefc4487a017f2f10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c94ba expref: 4105 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.344724:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e964c80/0xefc4487a017f2f10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c94ba expref: 4105 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.344734:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e964c80/0xefc4487a017f2f10 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c94ba expref: 4105 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.344742:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.344743:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.344745:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801314e9180/0xefc4487a01877b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c24 expref: 6058 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344750:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314e9180/0xefc4487a01877b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c24 expref: 6058 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344764:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801314e9180/0xefc4487a01877b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c24 expref: 6058 pid: 15145 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.344769:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323db700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584470656:192.168.203.41@tcp:105: 00000100:00100000:2.0:1705683932.344781:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009809c480 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.344789:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344789:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.344795:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413331 00000100:00100000:2.0:1705683932.344797:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cafdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1764:7265:x1788538640991040:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1705683932.344801:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.344832:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01877c46 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ca2 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.344881:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.344885:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.344888:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.344923:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.344926:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.344928:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.344989:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.344992:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.344994:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000004:00200000:2.0:1705683932.345006:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x42b2:0x0]: returning size 4096 00000004:00200000:2.0:1705683932.345007:0:8825:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.345012:0:8825:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345015:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345017:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345019:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345021:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345023:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a454500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.345024:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345026:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345029:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.345030:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.345031:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345033:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a454500/0xefc4487a01877c4d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345037:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345038:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345042:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345044:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad3c00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.345045:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345046:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345048:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff880098277900) 00010000:00010000:2.0:1705683932.345049:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.345050:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345052:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad3c00/0xefc4487a01877c5b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.345068:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01877c46 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ca2 expref: 1766 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345087:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ca2 expref: 1765 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345090:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.345090:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1705683932.345091:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cad0f00, rc 0) 00000100:00100000:2.0:1705683932.345099:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cafdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1765:7265:x1788538640991040:12345-192.168.203.41@tcp:101:rm.0 Request processed in 302us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.345102:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413331 00000100:00100000:2.0:1705683932.345127:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323da800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584470848:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.345139:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.345159:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801323de400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584470912:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.345166:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.345178:0:15131:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345182:0:15131:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345184:0:15131:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345187:0:15131:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345191:0:15131:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1705683932.345252:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea74100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3042:3082:x1788538584468096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7566us (7642us total) trans 4295348040 rc 0/0 00000100:00100000:2.0:1705683932.345255:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920420 00000100:00100000:2.0:1705683932.345261:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345262:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345264:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920449 00000100:00100000:2.0:1705683932.345266:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3041:3084:x1788538584470912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.345272:0:15131:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34412 count 1 00010000:00010000:2.0:1705683932.345401:0:15131:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345410:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b37ef80/0xefc4487a018060a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10e5 expref: 4097 pid: 15111 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345414:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6052 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345416:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.345417:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.345417:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345426:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6052 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345429:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6052 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.345433:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584471040:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.345444:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b37ef80/0xefc4487a018060a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10e5 expref: 4097 pid: 15111 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345447:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b37ef80/0xefc4487a018060a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10e5 expref: 4097 pid: 15111 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.345451:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584471104:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.345455:0:15131:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009809c240 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.345461:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.345469:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801323da800/2, rc 0, transno 380743 00000100:00100000:2.0:1705683932.345473:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323da800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584470848:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.345480:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ea70000/2, rc 0, transno 380744 00000100:00100000:2.0:1705683932.345481:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009ea70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584468096:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.345511:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.345513:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2d00/0xefc4487a01877b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345516:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009dfd2d00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.345517:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2d00/0xefc4487a01877b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345519:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2d00/0xefc4487a01877b4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345525:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2d00/0xefc4487a01877b4a lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345528:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dfd2d00/0xefc4487a01877b4a lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345617:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345618:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345618:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.345645:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345646:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345649:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584471232 00000100:00100000:2.0:1705683932.345658:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345659:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.345661:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920454 00000100:00100000:2.0:1705683932.345663:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea75a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3044:3081:x1788538584471232:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.345669:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34413 count 1 00010000:00010000:2.0:1705683932.345782:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345788:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be01900/0xefc4487a018061a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1101 expref: 4097 pid: 14219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345791:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013232b700/0xefc4487a0185983c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85cd expref: 6052 pid: 15110 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345794:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.345794:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.345795:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345802:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013232b700/0xefc4487a0185983c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85cd expref: 6052 pid: 15110 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345806:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013232b700/0xefc4487a0185983c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85cd expref: 6052 pid: 15110 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.345810:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584471552:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.345819:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be01900/0xefc4487a018061a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1101 expref: 4097 pid: 14219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.345823:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be01900/0xefc4487a018061a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1101 expref: 4097 pid: 14219 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.345826:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584471616:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.345830:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009804e300 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.345835:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.345836:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0c80/0xefc4487a01877b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345838:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009dfd0c80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.345839:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0c80/0xefc4487a01877b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345842:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0c80/0xefc4487a01877b89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345848:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0c80/0xefc4487a01877b89 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345850:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dfd0c80/0xefc4487a01877b89 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345858:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345858:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345859:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345918:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.345919:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081b5ad00/0xefc4487a01877b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345922:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880081b5ad00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.345923:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081b5ad00/0xefc4487a01877b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345926:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081b5ad00/0xefc4487a01877b82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345930:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081b5ad00/0xefc4487a01877b82 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345932:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081b5ad00/0xefc4487a01877b82 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.345940:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345940:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.345941:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.345994:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801323ddf00/2, rc 0, transno 380751 00000100:00100000:2.0:1705683932.345997:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323ddf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584469952:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.346012:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1705683932.346014:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584471872:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.346024:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.346200:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a67a5f00/2, rc 0, transno 380752 00000100:00100000:2.0:1705683932.346204:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584471872:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.346217:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1705683932.346220:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584472128:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.346233:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.346241:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a67a7800/2, rc 0, transno 380753 00000100:00100000:2.0:1705683932.346244:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584472064:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.346289:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.346290:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.346295:0:14236:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584472192 00000100:00100000:2.0:1705683932.346306:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.346307:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.346310:0:14236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920462 00000100:00100000:2.0:1705683932.346312:0:14236:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e010a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3051:3083:x1788538584472192:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.346320:0:14236:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34418 count 1 00010000:00010000:2.0:1705683932.346417:0:14236:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.346423:0:14236:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64b7480/0xefc4487a0180617a lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d118d expref: 4097 pid: 15215 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.346426:0:14236:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7e300/0xefc4487a01859890 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8613 expref: 6052 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.346429:0:14236:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.346430:0:14236:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.346430:0:14236:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.346439:0:14236:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb7e300/0xefc4487a01859890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8613 expref: 6052 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.346445:0:14236:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7e300/0xefc4487a01859890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8613 expref: 6052 pid: 14234 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.346449:0:14236:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a1400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584472512:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.346464:0:14236:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64b7480/0xefc4487a0180617a lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d118d expref: 4097 pid: 15215 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.346468:0:14236:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64b7480/0xefc4487a0180617a lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d118d expref: 4097 pid: 15215 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.346471:0:14236:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a67a0a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584472576:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.346476:0:14236:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800837693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.349323:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1705683932.349463:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323d9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584470528:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.349468:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323de900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584470592:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.349480:0:15118:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.349487:0:15118:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.349488:0:15118:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.349489:0:15118:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349502:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323db700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584470656:192.168.203.41@tcp:105: 00010000:00010000:2.0:1705683932.349510:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.349528:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b03da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4097:1856:x1788538640988992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 4825us (5036us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.349536:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332653 00000100:00100000:2.0:1705683932.349570:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349571:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349575:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332663 00000100:00100000:2.0:1705683932.349577:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008caf8a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6054:1856:x1788538640991552:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.349582:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.349584:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6054 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.349590:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6054 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.349599:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.349611:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008caf8a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6054:1856:x1788538640991552:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 33us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.349620:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332663 00000100:00100000:2.0:1705683932.349626:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349626:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349629:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332666 00000100:00100000:2.0:1705683932.349631:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3526:1856:x1788538640991808:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.349634:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.349641:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6712d00/0xefc4487a0186339a lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb147 expref: 3526 pid: 15170 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.349645:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6712d00/0xefc4487a0186339a lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb147 expref: 3526 pid: 15170 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.349655:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.349656:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.349657:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dfd2080/0xefc4487a01877c8c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300cbe expref: 3526 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349661:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dfd2080/0xefc4487a01877c8c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300cbe expref: 3526 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349672:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dfd2080/0xefc4487a01877c8c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300cbe expref: 3526 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.349677:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374a800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584472640:192.168.203.41@tcp:105: 00000100:00100000:2.0:1705683932.349690:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801319e8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.349704:0:15131:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801319d3200/0xefc4487a01859835 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85bf expref: 6052 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.349724:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584471040:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.349730:0:15131:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b37ef80/0xefc4487a018060a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x866c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d10e5 expref: 4095 pid: 15111 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.349734:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584471104:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.349741:0:15131:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.349746:0:15131:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.349747:0:15131:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.349747:0:15131:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.349748:0:15131:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349750:0:15131:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349753:0:15131:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349756:0:15131:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01877c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349762:0:15131:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.349848:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3052:3084:x1788538584470912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4581us (4681us total) trans 4295348050 rc 0/0 00000100:00100000:2.0:1705683932.349852:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920449 00000100:00100000:2.0:1705683932.349863:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349864:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349867:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920465 00000100:00100000:2.0:1705683932.349868:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea76e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4096:4708:x1788538640992128:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.349873:0:15131:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.349914:0:15131:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cad0a00/0xefc4487a01877ce0 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300cda expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349925:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfb6a80/0xefc4487a018478d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecbd6 expref: 6051 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.349928:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.349929:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.349930:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad0a00/0xefc4487a01877ce0 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300cda expref: 4097 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.349938:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfb6a80/0xefc4487a018478d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecbd6 expref: 6051 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.349941:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfb6a80/0xefc4487a018478d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecbd6 expref: 6051 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.349945:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073748500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584472768:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.349955:0:15131:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009809c240 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.349962:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349962:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.349965:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413335 00000100:00100000:2.0:1705683932.349967:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1906:7261:x1788538640992000:12345-192.168.203.41@tcp:36:lfs.0 00000100:00100000:2.0:1705683932.350002:0:6531:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1788538584472896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1705683932.350016:0:6531:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.350023:0:6531:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013541cc00 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.350035:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801323de400/2, rc 0, transno 380754 00000100:00100000:2.0:1705683932.350039:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801323de400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584470912:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.350066:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073749900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584472960:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.350088:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.350100:0:15118:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350104:0:15118:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350107:0:15118:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350109:0:15118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350114:0:15118:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.350171:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3053:3082:x1788538584470400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5815us (5857us total) trans 4295348051 rc 0/0 00000100:00100000:2.0:1705683932.350175:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920446 00000100:00100000:2.0:1705683932.350181:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350181:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350183:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920469 00000100:00100000:2.0:1705683932.350185:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073749400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3052:3084:x1788538584472960:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.350231:0:15118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9581:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.350233:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9581:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.350233:0:15118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9581:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.350234:0:15118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9581:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.350235:0:15118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9581:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.350247:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073749400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3053:3084:x1788538584472960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 62us (159us total) trans 4295348052 rc 0/0 00000100:00100000:2.0:1705683932.350250:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920469 00010000:00010000:2.0:1705683932.350259:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.350260:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350263:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880099fcd180 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.350264:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350268:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350273:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350275:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fcd180/0xefc4487a01877c23 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350282:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.350283:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.350283:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.350292:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880073749900/2, rc 0, transno 380756 00000100:00100000:2.0:1705683932.350293:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073749900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584472960:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.350304:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013232b700/0xefc4487a0185983c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f85cd expref: 6051 pid: 15110 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350311:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584471552:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.350318:0:14236:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a1400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584472512:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.350321:0:14236:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a0a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584472576:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.350331:0:14236:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.350334:0:14236:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.350335:0:14236:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.350335:0:14236:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350338:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350339:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350342:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473024 00000100:00100000:2.0:1705683932.350349:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350350:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350352:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920470 00000100:00100000:2.0:1705683932.350354:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3053:3081:x1788538584473024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.350360:0:15110:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34419 count 1 00010000:00010000:2.0:1705683932.350440:0:15110:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350445:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4098 pid: 15215 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350448:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f57700/0xefc4487a01859897 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8621 expref: 6050 pid: 15187 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350454:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.350454:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.350455:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350463:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f57700/0xefc4487a01859897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8621 expref: 6050 pid: 15187 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350467:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f57700/0xefc4487a01859897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8621 expref: 6050 pid: 15187 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350471:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073749e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584473152:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.350483:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4097 pid: 15215 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350487:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4097 pid: 15215 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350490:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374ee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584473216:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.350494:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a480 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.350513:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1705683932.350517:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e017300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584473280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.350526:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.350534:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350534:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350537:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473280 00000100:00100000:2.0:1705683932.350545:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350545:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350547:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920472 00000100:00100000:2.0:1705683932.350548:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3055:3084:x1788538584473280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.350554:0:15118:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34420 count 1 00010000:00010000:2.0:1705683932.350652:0:15118:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350657:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5e00/0xefc4487a018061ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11c5 expref: 4103 pid: 14237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350660:0:15118:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084bc8a00/0xefc4487a018598a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f862f expref: 6055 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350663:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.350663:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.350664:0:15118:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350672:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084bc8a00/0xefc4487a018598a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f862f expref: 6055 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350675:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084bc8a00/0xefc4487a018598a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f862f expref: 6055 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350679:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584473344:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.350689:0:15118:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5e00/0xefc4487a018061ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11c5 expref: 4100 pid: 14237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.350693:0:15118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5e00/0xefc4487a018061ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11c5 expref: 4100 pid: 14237 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350697:0:15118:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584473408:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.350701:0:15118:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.350727:0:6531:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1788538584472896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1705683932.350751:0:6531:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1788538584473472:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1705683932.350761:0:6531:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.350767:0:6531:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a000 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.350772:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350773:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350775:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473472 00000100:00100000:2.0:1705683932.350783:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350784:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.350786:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59872 00000100:00100000:2.0:1705683932.350787:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:6531:x1788538584473472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1705683932.350821:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:6531:x1788538584473472:12345-0@lo:1000:mdt00_000.0 Request processed in 33us (59us total) trans 0 rc 1/1 00000100:00100000:2.0:1705683932.350824:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59872 00000100:00100000:2.0:1705683932.350838:0:6531:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1788538584473472:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1705683932.350859:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1906:7261:x1788538640992000:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 890us (1270us total) trans 0 rc -17/-17 00000100:00100000:2.0:1705683932.350864:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413335 00000100:00100000:2.0:1705683932.350885:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374a800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584472640:192.168.203.41@tcp:105: 00010000:00010000:2.0:1705683932.350893:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.350902:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3524:1856:x1788538640991808:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1270us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.350906:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332666 00010000:00010000:2.0:1705683932.350930:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.350932:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a1653980/0xefc4487a01877ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350935:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1653980 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.350936:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1653980/0xefc4487a01877ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350940:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1653980/0xefc4487a01877ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350945:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a1653980/0xefc4487a01877ca8 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350948:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1653980/0xefc4487a01877ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350954:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.350955:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.350955:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.350963:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be01900/0xefc4487a018061a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x866d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1101 expref: 4095 pid: 14219 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.350968:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a67a6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584471616:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.350974:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.350977:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.350977:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.350977:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.350978:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350980:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350983:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350985:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.350990:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.351048:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea75a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3056:3081:x1788538584471232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5383us (5409us total) trans 4295348055 rc 0/0 00000100:00100000:2.0:1705683932.351052:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920454 00010000:00010000:2.0:1705683932.351064:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.351066:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351070:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad2300 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.351071:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351091:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351100:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351102:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a01877c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351110:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.351111:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a1651180/0xefc4487a01877cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351114:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1651180 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.351115:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1651180/0xefc4487a01877cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351117:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1651180/0xefc4487a01877cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351121:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a1651180/0xefc4487a01877cb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351123:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1651180/0xefc4487a01877cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351133:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351133:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351134:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351137:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351141:0:14236:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351144:0:14236:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351148:0:14236:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351150:0:14236:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.351155:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351155:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351158:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473600 00000100:00100000:2.0:1705683932.351166:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351166:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351168:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920473 00000100:00100000:2.0:1705683932.351170:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e011900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3057:3084:x1788538584473600:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.351209:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9583:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351210:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9583:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351211:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9583:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351212:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9583:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351213:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9583:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.351228:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e011900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3058:3084:x1788538584473600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (88us total) trans 4295348057 rc 0/0 00000100:00100000:2.0:1705683932.351231:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920473 00010000:00010000:2.0:1705683932.351248:0:14236:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.351251:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351252:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351254:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473728 00000100:00100000:2.0:1705683932.351259:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351260:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351261:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920475 00000100:00100000:2.0:1705683932.351263:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e010500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3058:3082:x1788538584473728:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.351294:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9584:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351295:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9584:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351296:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9584:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351297:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9584:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.351298:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9584:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.351313:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e010500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3060:3082:x1788538584473728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 50us (77us total) trans 4295348059 rc 0/0 00000100:00100000:2.0:1705683932.351316:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920475 00000100:00100000:2.0:1705683932.351321:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351321:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351323:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584473792 00000100:00100000:2.0:1705683932.351328:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351329:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351330:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920476 00000100:00100000:2.0:1705683932.351332:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3059:3084:x1788538584473792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.351337:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34422 count 1 00010000:00010000:2.0:1705683932.351400:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351407:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800989da300/0xefc4487a018061f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11f6 expref: 4092 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.351411:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f57200/0xefc4487a018598c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f864b expref: 6047 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.351413:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.351414:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.351414:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351422:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f57200/0xefc4487a018598c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f864b expref: 6046 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.351426:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f57200/0xefc4487a018598c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f864b expref: 6046 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.351430:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584474112:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.351440:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800989da300/0xefc4487a018061f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11f6 expref: 4091 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.351443:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800989da300/0xefc4487a018061f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11f6 expref: 4091 pid: 15153 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.351447:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584474176:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.351451:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a600 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.351456:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.351457:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351460:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad2580 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.351461:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351464:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351469:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351471:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cad2580/0xefc4487a01877cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351478:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.351479:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366e080/0xefc4487a01877caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351481:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366e080 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.351482:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366e080/0xefc4487a01877caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351484:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366e080/0xefc4487a01877caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351491:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366e080/0xefc4487a01877caf lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351493:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366e080/0xefc4487a01877caf lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351498:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351499:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351499:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.351501:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.351503:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351503:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.351506:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640993536 00000100:00100000:2.0:1705683932.351516:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413338 00000100:00100000:2.0:1705683932.351518:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801323dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1857:7308:x1788538640993536:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.351522:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.351577:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b700/0xefc4487a01877d6c lrc: 2/0,0 mode: --/CW res: [0x240000400:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300d0b expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351624:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.351630:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351635:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351641:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.351645:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351649:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351726:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.351730:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351733:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000004:00200000:2.0:1705683932.351737:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4251:0x0]: returning size 0 00010000:00010000:2.0:1705683932.351802:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351807:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351810:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351813:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e23a080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.351814:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351818:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351823:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4251:0x0].0x0 (ffff880098277700) 00010000:00010000:2.0:1705683932.351825:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1705683932.351826:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351829:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01877d88 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x4251:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351840:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351844:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351847:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351850:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351853:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e239400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.351854:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351857:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351862:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17b:0x0].0x0 (ffff880098277f00) 00010000:00010000:2.0:1705683932.351864:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.351865:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351868:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01877d73 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351873:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351876:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351878:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351880:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e23b980 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.351880:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351882:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351885:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17b:0x0].0x31 (ffff88013513eb00) 00010000:00010000:2.0:1705683932.351886:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.351886:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351888:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01877d7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.351904:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b700/0xefc4487a01877d6c lrc: 1/0,0 mode: --/CW res: [0x240000400:0x17b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d0b expref: 1859 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351907:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b700/0xefc4487a01877d6c lrc: 0/0,0 mode: --/CW res: [0x240000400:0x17b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d0b expref: 1859 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.351912:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e23b700, rc 0) 00000100:00100000:2.0:1705683932.351925:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801323dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1858:7308:x1788538640993536:12345-192.168.203.41@tcp:101:dd.0 Request processed in 407us (583us total) trans 4295084920 rc 301/301 00000100:00100000:2.0:1705683932.351928:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413338 00000100:00100000:2.0:1705683932.351993:0:14236:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e010a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3066:3083:x1788538584472192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5680us (5714us total) trans 4295348064 rc 0/0 00000100:00100000:2.0:1705683932.351996:0:14236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920462 00000100:00100000:2.0:1705683932.352041:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352042:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352045:0:14236:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584474752 00000100:00100000:2.0:1705683932.352051:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352051:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352053:0:14236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920483 00000100:00100000:2.0:1705683932.352054:0:14236:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3066:3082:x1788538584474752:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.352104:0:14236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9588:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.352105:0:14236:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9588:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.352106:0:14236:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9588:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.352107:0:14236:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9588:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.352107:0:14236:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9588:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.352126:0:14236:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3067:3082:x1788538584474752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 71us (88us total) trans 4295348065 rc 0/0 00000100:00100000:2.0:1705683932.352129:0:14236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920483 00000100:00100000:2.0:1705683932.352202:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352202:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352205:0:14236:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584474944 00000100:00100000:2.0:1705683932.352210:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352210:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.352212:0:14236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920484 00000100:00100000:2.0:1705683932.352214:0:14236:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d50500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3067:3084:x1788538584474944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.352219:0:14236:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34426 count 1 00010000:00010000:2.0:1705683932.352280:0:14236:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.352285:0:14236:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801357eca00/0xefc4487a01806268 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d127b expref: 4091 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.352289:0:14236:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084bc8f00/0xefc4487a01859923 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8683 expref: 6046 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.352291:0:14236:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.352292:0:14236:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.352292:0:14236:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.352300:0:14236:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084bc8f00/0xefc4487a01859923 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8683 expref: 6046 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.352304:0:14236:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084bc8f00/0xefc4487a01859923 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8683 expref: 6046 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.352308:0:14236:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584475008:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.352329:0:14236:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801357eca00/0xefc4487a01806268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d127b expref: 4091 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.352333:0:14236:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801357eca00/0xefc4487a01806268 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d127b expref: 4091 pid: 15153 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.352337:0:14236:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073748a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584475072:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.352343:0:14236:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.354044:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073748500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584472768:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.354058:0:15131:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cad0a00/0xefc4487a01877ce0 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300cda expref: 4091 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354065:0:15131:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cad0a00, rc 0) 00000100:00100000:2.0:1705683932.354093:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea76e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4091:4708:x1788538640992128:12345-192.168.203.41@tcp:101:dd.0 Request processed in 4223us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.354096:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920465 00000100:00100000:2.0:1705683932.354105:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354105:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354116:0:15131:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640993600 00000100:00100000:2.0:1705683932.354125:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354126:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354128:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920485 00000100:00100000:2.0:1705683932.354130:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6047:6521:x1788538640993600:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.354135:0:15131:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.354356:0:15131:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e239900/0xefc4487a01877dab lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300d12 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.354366:0:15131:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.354373:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.354374:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.354376:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e239900/0xefc4487a01877dab lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d12 expref: 6051 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354382:0:15131:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e239900/0xefc4487a01877dab lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d12 expref: 6051 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354385:0:15131:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e239900, rc 0) 00000100:00100000:2.0:1705683932.354396:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6051:6521:x1788538640993600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 265us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.354399:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920485 00000100:00100000:2.0:1705683932.354410:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354411:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354414:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332681 00000100:00100000:2.0:1705683932.354416:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4095:1857:x1788538640994112:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.354420:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.354422:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4095 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.354425:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4095 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.354431:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5b80/0xefc4487a0180619d lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11a9 expref: 4095 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.354436:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.354442:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4094:1857:x1788538640994112:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.354445:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332681 00000100:00100000:2.0:1705683932.354450:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354450:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354452:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332683 00000100:00100000:2.0:1705683932.354453:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6050:1857:x1788538640994368:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.354456:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.354457:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084bca080/0xefc4487a018598b3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x8675:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f863d expref: 6050 pid: 15168 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.354461:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084bca080/0xefc4487a018598b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8675:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f863d expref: 6050 pid: 15168 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.354466:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.354470:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6050:1857:x1788538640994368:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 16us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.354483:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332683 00000100:00100000:2.0:1705683932.354486:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354486:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354488:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332687 00000100:00100000:2.0:1705683932.354490:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4092:1857:x1788538640994304:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.354492:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.354493:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a16cf480/0xefc4487a0181bc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d90c8 expref: 4092 pid: 15164 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.354497:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a16cf480/0xefc4487a0181bc94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d90c8 expref: 4092 pid: 15164 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.354503:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a16cf480/0xefc4487a0181bc94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d90c8 expref: 4092 pid: 15164 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.354507:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.354508:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.354509:0:6520:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4f00/0xefc4487a01877d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ce8 expref: 6047 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354516:0:6520:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4f00/0xefc4487a01877d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ce8 expref: 6046 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354525:0:6520:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4f00/0xefc4487a01877d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ce8 expref: 6046 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.354529:0:6520:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073748500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6520:1788538584475392:192.168.203.41@tcp:105: 00000100:00100000:2.0:1705683932.354539:0:6520:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33acc0 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.354553:0:15118:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084bc8a00/0xefc4487a018598a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f862f expref: 6045 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.354559:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584473344:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.354563:0:15118:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64b5e00/0xefc4487a018061ab lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11c5 expref: 4091 pid: 14237 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.354566:0:15118:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:15118:1788538584473408:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.354575:0:15118:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.354578:0:15118:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.354579:0:15118:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.354579:0:15118:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.354580:0:15118:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354585:0:15118:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354588:0:15118:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354590:0:15118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354597:0:15118:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.354676:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3068:3084:x1788538584473280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4127us (4149us total) trans 4295348066 rc 0/0 00000100:00100000:2.0:1705683932.354679:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920472 00010000:00010000:2.0:1705683932.354689:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.354691:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354694:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e23b480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.354694:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354698:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354703:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354721:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01877d26 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354729:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.354729:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.354730:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.354740:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e017300/2, rc 0, transno 380770 00000100:00100000:2.0:1705683932.354744:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e017300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584473280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.354771:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584475456:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.354782:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.354790:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354791:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354794:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584475456 00000100:00100000:2.0:1705683932.354800:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354800:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.354802:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920488 00000100:00100000:2.0:1705683932.354803:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3068:3084:x1788538584475456:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.354848:0:15118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9589:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.354849:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9589:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.354850:0:15118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9589:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.354851:0:15118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9589:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.354851:0:15118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9589:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.354864:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3069:3084:x1788538584475456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 60us (82us total) trans 4295348067 rc 0/0 00000100:00100000:2.0:1705683932.354867:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920488 00000004:00080000:2.0:1705683932.354880:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007374df00/2, rc 0, transno 380771 00000100:00100000:2.0:1705683932.354883:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584475456:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.354887:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.354889:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354892:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad3480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.354893:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354897:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354902:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354904:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cad3480/0xefc4487a01877d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.354912:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.354913:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.354913:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.354927:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1705683932.354930:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374e900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584475520:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.354941:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.354952:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e014b00/2, rc 0, transno 380772 00000100:00100000:2.0:1705683932.354955:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e014b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584473024:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.354965:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584475584:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.354972:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.355084:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007374ad00/2, rc 0, transno 380773 00000100:00100000:2.0:1705683932.355087:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584475584:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.355124:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374d000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584475648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.355134:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.355730:0:14236:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584475008:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.355744:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584474112:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.355748:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584474176:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.355757:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.355764:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.355764:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.355765:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.355771:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.355773:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.355778:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332690 00000100:00100000:2.0:1705683932.355782:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6045:1857:x1788538640994496:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.355789:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.355792:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c393c00/0xefc4487a0185991c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8675 expref: 6045 pid: 15098 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.355799:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c393c00/0xefc4487a0185991c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8675 expref: 6045 pid: 15098 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.355809:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c393c00/0xefc4487a0185991c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8675 expref: 6045 pid: 15098 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.355817:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.355818:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.355819:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355824:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355837:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.355851:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6043:1857:x1788538640994496:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.355854:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332690 00010000:00010000:2.0:1705683932.355869:0:14236:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801357eca00/0xefc4487a01806268 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x867a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d127b expref: 4089 pid: 15153 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.355875:0:14236:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073748a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:14236:1788538584475072:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.355883:0:14236:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.355886:0:14236:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.355886:0:14236:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.355887:0:14236:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.355887:0:14236:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355890:0:14236:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355896:0:14236:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355898:0:14236:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355904:0:14236:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1705683932.355908:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.355909:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355912:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a62f4500 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.355913:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355916:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355920:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355922:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f4500/0xefc4487a01877d96 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355930:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.355931:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355934:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e238780 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.355935:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355937:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355941:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355943:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01877d9d lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.355948:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.355949:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.355949:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.355978:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6658000/2, rc 0, transno 380774 00000100:00100000:2.0:1705683932.355984:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584474688:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356006:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356007:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356013:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332694 00000100:00100000:2.0:1705683932.356016:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4090:1857:x1788538640994880:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.356020:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.356022:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b37980/0xefc4487a018061ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11da expref: 4090 pid: 15143 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.356030:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b37980/0xefc4487a018061ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d11da expref: 4090 pid: 15143 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.356036:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356037:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356038:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dc8c000/0xefc4487a01877d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356041:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dc8c000/0xefc4487a01877d49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356046:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.356055:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4090:1857:x1788538640994880:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.356058:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332694 00000100:00100000:2.0:1705683932.356097:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.356101:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073748a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584475968:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356113:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.356130:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.356131:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356135:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366ed00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.356136:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356141:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356147:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877d57 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356149:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366ed00/0xefc4487a01877d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356156:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356157:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356157:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356159:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356162:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356165:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356167:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356171:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.356235:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3073:3084:x1788538584473792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4902us (4933us total) trans 4295348073 rc 0/0 00000100:00100000:2.0:1705683932.356240:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920476 00010000:00010000:2.0:1705683932.356249:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.356250:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356253:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e238c80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.356254:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356257:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356261:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356263:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e238c80/0xefc4487a01877d50 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356270:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356271:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356271:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.356290:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e012800/2, rc 0, transno 380777 00000100:00100000:2.0:1705683932.356292:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e012800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584473792:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356302:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374cb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584476032:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356312:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.356318:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1705683932.356320:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88007374a800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584476096:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356326:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.356335:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e010f00/2, rc 0, transno 380775 00000100:00100000:2.0:1705683932.356338:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e010f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584474048:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356355:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356356:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356358:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584476096 00000100:00100000:2.0:1705683932.356365:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356366:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356367:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640995328 00000100:00100000:2.0:1705683932.356372:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356373:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356374:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584476160 00000100:00100000:2.0:1705683932.356377:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356377:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356380:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920494 00000100:00100000:2.0:1705683932.356383:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3437:6521:x1788538640995328:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.356387:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.356503:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e23b200/0xefc4487a01877df8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300d35 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.356511:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.356516:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356517:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356519:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e23b200/0xefc4487a01877df8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d35 expref: 3438 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356524:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e23b200/0xefc4487a01877df8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d35 expref: 3438 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356527:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e23b200, rc 0) 00000100:00100000:2.0:1705683932.356540:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3438:6521:x1788538640995328:12345-192.168.203.41@tcp:101:dd.0 Request processed in 157us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.356543:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920494 00000100:00100000:2.0:1705683932.356586:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584476352:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.356597:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.356606:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.356607:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a64280/0xefc4487a01877d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356611:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880099a64280 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.356612:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a64280/0xefc4487a01877d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356615:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a64280/0xefc4487a01877d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356620:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a64280/0xefc4487a01877d81 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356622:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a64280/0xefc4487a01877d81 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356629:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356629:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.356630:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.356632:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356632:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356635:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584476352 00000100:00100000:2.0:1705683932.356641:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356641:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356643:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920497 00000100:00100000:2.0:1705683932.356644:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007374ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3077:3084:x1788538584476352:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.356683:0:15223:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x958d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.356684:0:15223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x958d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.356685:0:15223:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x958d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.356686:0:15223:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x958d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.356686:0:15223:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x958d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.356702:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007374ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3077:3084:x1788538584476352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (105us total) trans 4295348076 rc 0/0 00000100:00100000:2.0:1705683932.356705:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920497 00000100:00100000:2.0:1705683932.356729:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356729:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356732:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584476480 00000100:00100000:2.0:1705683932.356738:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356738:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.356740:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920498 00000100:00100000:2.0:1705683932.356742:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3077:3081:x1788538584476480:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.356748:0:15223:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34431 count 1 00010000:00010000:2.0:1705683932.356892:0:15223:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356898:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aea1180/0xefc4487a018062fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1307 expref: 4085 pid: 14278 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.356903:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01859946 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86c9 expref: 6038 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.356912:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356912:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.356913:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.356926:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01859946 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86c9 expref: 6038 pid: 14234 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.356932:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01859946 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86c9 expref: 6038 pid: 14234 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.356939:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073749e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584476736:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.356963:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aea1180/0xefc4487a018062fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1307 expref: 4085 pid: 14278 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.356969:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aea1180/0xefc4487a018062fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1307 expref: 4085 pid: 14278 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.356976:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584476800:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.356991:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a600 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.357050:0:14236:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d50500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3080:3084:x1788538584474944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4835us (4857us total) trans 4295348078 rc 0/0 00000100:00100000:2.0:1705683932.357054:0:14236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920484 00000100:00100000:2.0:1705683932.357125:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357126:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357128:0:14236:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584476992 00000100:00100000:2.0:1705683932.357135:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357135:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357140:0:14236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920501 00000100:00100000:2.0:1705683932.357141:0:14236:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133634600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3081:3084:x1788538584476992:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.357180:0:14236:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x958f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.357181:0:14236:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x958f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.357182:0:14236:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x958f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.357183:0:14236:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x958f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.357183:0:14236:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x958f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.357200:0:14236:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133634600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3082:3084:x1788538584476992:12345-0@lo:2:osp-syn-1-1.0 Request processed in 58us (80us total) trans 4295348080 rc 0/0 00000100:00100000:2.0:1705683932.357203:0:14236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920501 00000100:00100000:2.0:1705683932.357592:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357593:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357675:0:15173:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880092c5b200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:15173:1788538584475136:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.357685:0:15173:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5180/0xefc4487a01877da4 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9517:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d27 expref: 4084 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.357691:0:15173:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62f5180, rc 0) 00000100:00100000:2.0:1705683932.357703:0:15173:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4084:6554:x1788538640993792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 3511us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.357706:0:15173:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920487 00000100:00100000:2.0:1705683932.357743:0:15173:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357744:0:15173:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357746:0:15173:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640995392 00000100:00100000:2.0:1705683932.357753:0:15173:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357753:0:15173:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357756:0:15173:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920505 00000100:00100000:2.0:1705683932.357757:0:15173:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133631400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4084:6496:x1788538640995392:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.357761:0:15173:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.357897:0:15173:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e239180/0xefc4487a01877e37 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x91ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300d3c expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.357904:0:15173:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x91ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.357910:0:15173:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.357910:0:15173:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.357912:0:15173:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e239180/0xefc4487a01877e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x91ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d3c expref: 4086 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.357917:0:15173:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e239180/0xefc4487a01877e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x91ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d3c expref: 4086 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.357921:0:15173:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e239180, rc 0) 00000100:00100000:2.0:1705683932.357931:0:15173:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133631400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4086:6496:x1788538640995392:12345-192.168.203.41@tcp:101:dd.0 Request processed in 173us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.357933:0:15173:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920505 00000100:00100000:2.0:1705683932.357947:0:6520:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073748500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6520:1788538584475392:192.168.203.41@tcp:105: 00010000:00010000:2.0:1705683932.357953:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.357959:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4085:1857:x1788538640994304:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 3469us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.357962:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332687 00000100:00100000:2.0:1705683932.357978:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357979:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.357982:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413342 00000100:00100000:2.0:1705683932.357984:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1770:7304:x1788538640995776:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:2.0:1705683932.357997:0:8825:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1705683932.358004:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a62f6a80/0xefc4487a01877c77 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x406f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ca9 expref: 1770 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.358010:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x406f:0x0].0x0 (ffff880099994400) 00010000:00010000:2.0:1705683932.358014:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a01877a78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300bfa expref: 1769 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.358018:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:2.0:1705683932.358020:0:8825:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1705683932.358027:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.358031:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.358034:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.358063:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013232bc00/0xefc4487a01877e45 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3fe1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.358065:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013232bc00/0xefc4487a01877e45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.358068:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013232bc00/0xefc4487a01877e45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.358109:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.358112:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.358115:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000040:00080000:2.0:1705683932.359322:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].313, 64 off28320 00000040:00080000:2.0:1705683932.359334:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4334, 64 off314656 00000040:00080000:2.0:1705683932.359339:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].314, 64 off28384 00000040:00080000:2.0:1705683932.359342:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4335, 64 off314720 00000040:00080000:2.0:1705683932.359346:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].315, 64 off28448 00000040:00080000:2.0:1705683932.359350:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4336, 64 off314784 00000040:00080000:2.0:1705683932.359354:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].316, 64 off28512 00000040:00080000:2.0:1705683932.359357:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4337, 64 off314848 00000040:00080000:2.0:1705683932.359361:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].317, 64 off28576 00000040:00080000:2.0:1705683932.359365:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4338, 64 off314912 00000040:00080000:2.0:1705683932.359368:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].318, 64 off28640 00000040:00080000:2.0:1705683932.359372:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4339, 64 off314976 00000040:00080000:2.0:1705683932.359421:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].319, 64 off28704 00000040:00080000:2.0:1705683932.359428:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4340, 64 off315040 00000040:00080000:2.0:1705683932.359433:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].320, 64 off28768 00000040:00080000:2.0:1705683932.359436:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4341, 64 off315104 00000040:00080000:2.0:1705683932.359440:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].321, 64 off28832 00000040:00080000:2.0:1705683932.359443:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4342, 64 off315168 00000040:00080000:2.0:1705683932.359447:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].322, 64 off28896 00000040:00080000:2.0:1705683932.359450:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4343, 64 off315232 00000040:00080000:2.0:1705683932.359454:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].323, 64 off28960 00000040:00080000:2.0:1705683932.359457:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4344, 64 off315296 00000040:00080000:2.0:1705683932.359461:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].324, 64 off29024 00000040:00080000:2.0:1705683932.359464:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4345, 64 off315360 00000040:00080000:2.0:1705683932.359468:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].325, 64 off29088 00000040:00080000:2.0:1705683932.359490:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4346, 64 off315424 00000040:00080000:2.0:1705683932.359496:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].326, 64 off29152 00000040:00080000:2.0:1705683932.359500:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4347, 64 off315488 00000040:00080000:2.0:1705683932.359504:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].327, 64 off29216 00000040:00080000:2.0:1705683932.359508:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4348, 64 off315552 00000040:00080000:2.0:1705683932.359511:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].328, 64 off29280 00000040:00080000:2.0:1705683932.359515:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4349, 64 off315616 00000040:00080000:2.0:1705683932.359518:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].329, 64 off29344 00000040:00080000:2.0:1705683932.359522:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4350, 64 off315680 00000040:00080000:2.0:1705683932.359525:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].330, 64 off29408 00000040:00080000:2.0:1705683932.359529:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4351, 64 off315744 00000040:00080000:2.0:1705683932.359532:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].331, 64 off29472 00000040:00080000:2.0:1705683932.359536:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4352, 64 off315808 00000040:00080000:2.0:1705683932.359539:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].332, 64 off29536 00000040:00080000:2.0:1705683932.359542:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4353, 64 off315872 00000040:00080000:2.0:1705683932.359546:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].333, 64 off29600 00000040:00080000:2.0:1705683932.359549:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4354, 64 off315936 00000040:00080000:2.0:1705683932.359553:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].334, 64 off29664 00000040:00080000:2.0:1705683932.359556:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4355, 64 off316000 00000040:00080000:2.0:1705683932.359560:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].335, 64 off29728 00000040:00080000:2.0:1705683932.359563:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4356, 64 off316064 00000040:00080000:2.0:1705683932.359566:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].336, 64 off29792 00000040:00080000:2.0:1705683932.359570:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4357, 64 off316128 00000040:00080000:2.0:1705683932.359573:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].337, 64 off29856 00000040:00080000:2.0:1705683932.359577:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4358, 64 off316192 00000040:00080000:2.0:1705683932.359580:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].338, 64 off29920 00000040:00080000:2.0:1705683932.359584:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4359, 64 off316256 00000040:00080000:2.0:1705683932.359587:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].339, 64 off29984 00000040:00080000:2.0:1705683932.359590:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4360, 64 off316320 00000040:00080000:2.0:1705683932.359594:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].340, 64 off30048 00000040:00080000:2.0:1705683932.359597:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4361, 64 off316384 00000040:00080000:2.0:1705683932.359601:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].341, 64 off30112 00000040:00080000:2.0:1705683932.359604:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4362, 64 off316448 00000040:00080000:2.0:1705683932.359607:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].342, 64 off30176 00000040:00080000:2.0:1705683932.359611:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4363, 64 off316512 00000040:00080000:2.0:1705683932.359619:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].343, 64 off30240 00000040:00080000:2.0:1705683932.359625:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4364, 64 off316576 00000040:00080000:2.0:1705683932.359631:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].344, 64 off30304 00000040:00080000:2.0:1705683932.359637:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4365, 64 off316640 00000040:00080000:2.0:1705683932.359643:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].345, 64 off30368 00000040:00080000:2.0:1705683932.359650:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4366, 64 off316704 00000040:00080000:2.0:1705683932.359658:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].346, 64 off30432 00000040:00080000:2.0:1705683932.359664:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4367, 64 off316768 00000040:00080000:2.0:1705683932.359671:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].347, 64 off30496 00000040:00080000:2.0:1705683932.359677:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4368, 64 off316832 00000040:00080000:2.0:1705683932.359684:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].348, 64 off30560 00000040:00080000:2.0:1705683932.359691:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4369, 64 off316896 00000040:00080000:2.0:1705683932.359698:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].349, 64 off30624 00000040:00080000:2.0:1705683932.359704:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4370, 64 off316960 00000040:00080000:2.0:1705683932.359719:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].350, 64 off30688 00000040:00080000:2.0:1705683932.359727:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4371, 64 off317024 00000040:00080000:2.0:1705683932.359731:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].351, 64 off30752 00000040:00080000:2.0:1705683932.359735:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4372, 64 off317088 00000040:00080000:2.0:1705683932.359738:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].352, 64 off30816 00000040:00080000:2.0:1705683932.359742:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4373, 64 off317152 00000040:00080000:2.0:1705683932.359746:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].353, 64 off30880 00000040:00080000:2.0:1705683932.359749:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4374, 64 off317216 00000040:00080000:2.0:1705683932.359752:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].354, 64 off30944 00000040:00080000:2.0:1705683932.359756:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4375, 64 off317280 00000040:00080000:2.0:1705683932.359759:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].355, 64 off31008 00000040:00080000:2.0:1705683932.359763:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4376, 64 off317344 00000040:00080000:2.0:1705683932.359766:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].356, 64 off31072 00000040:00080000:2.0:1705683932.359769:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4377, 64 off317408 00000040:00080000:2.0:1705683932.359773:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].357, 64 off31136 00000040:00080000:2.0:1705683932.359776:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4378, 64 off317472 00000040:00080000:2.0:1705683932.359780:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].358, 64 off31200 00000040:00080000:2.0:1705683932.359783:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4379, 64 off317536 00000040:00080000:2.0:1705683932.359787:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].359, 64 off31264 00000040:00080000:2.0:1705683932.359790:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4380, 64 off317600 00000040:00080000:2.0:1705683932.359794:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].360, 64 off31328 00000040:00080000:2.0:1705683932.359797:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4381, 64 off317664 00000040:00080000:2.0:1705683932.359801:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].361, 64 off31392 00000040:00080000:2.0:1705683932.359804:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4382, 64 off317728 00000040:00080000:2.0:1705683932.359807:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].362, 64 off31456 00000040:00080000:2.0:1705683932.359811:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4383, 64 off317792 00000040:00080000:2.0:1705683932.359814:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].363, 64 off31520 00000040:00080000:2.0:1705683932.359818:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4384, 64 off317856 00000040:00080000:2.0:1705683932.359821:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].364, 64 off31584 00000040:00080000:2.0:1705683932.359824:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4385, 64 off317920 00000040:00080000:2.0:1705683932.359828:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].365, 64 off31648 00000040:00080000:2.0:1705683932.359831:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4386, 64 off317984 00000040:00080000:2.0:1705683932.359835:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].366, 64 off31712 00000040:00080000:2.0:1705683932.359838:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4387, 64 off318048 00000040:00080000:2.0:1705683932.359841:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].367, 64 off31776 00000040:00080000:2.0:1705683932.359845:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4388, 64 off318112 00000040:00080000:2.0:1705683932.359848:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].368, 64 off31840 00000040:00080000:2.0:1705683932.359852:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4389, 64 off318176 00000040:00080000:2.0:1705683932.359855:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].369, 64 off31904 00000040:00080000:2.0:1705683932.359858:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4390, 64 off318240 00000040:00080000:2.0:1705683932.359862:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].370, 64 off31968 00000040:00080000:2.0:1705683932.359865:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4391, 64 off318304 00000040:00080000:2.0:1705683932.359868:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].371, 64 off32032 00000040:00080000:2.0:1705683932.359872:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4392, 64 off318368 00000040:00080000:2.0:1705683932.359875:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].372, 64 off32096 00000040:00080000:2.0:1705683932.359879:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4393, 64 off318432 00000040:00080000:2.0:1705683932.359882:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].373, 64 off32160 00000040:00080000:2.0:1705683932.359885:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4394, 64 off318496 00000040:00080000:2.0:1705683932.359889:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].374, 64 off32224 00000040:00080000:2.0:1705683932.359892:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4395, 64 off318560 00000040:00080000:2.0:1705683932.359896:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].375, 64 off32288 00000040:00080000:2.0:1705683932.359899:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4396, 64 off318624 00000040:00080000:2.0:1705683932.359903:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].376, 64 off32352 00000040:00080000:2.0:1705683932.359906:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4397, 64 off318688 00000040:00080000:2.0:1705683932.359910:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].377, 64 off32416 00000040:00080000:2.0:1705683932.359913:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4398, 64 off318752 00000040:00080000:2.0:1705683932.359916:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].378, 64 off32480 00000040:00080000:2.0:1705683932.359920:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4399, 64 off318816 00000040:00080000:2.0:1705683932.359923:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].379, 64 off32544 00000040:00080000:2.0:1705683932.359926:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4400, 64 off318880 00000040:00080000:2.0:1705683932.359930:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].380, 64 off32608 00000040:00080000:2.0:1705683932.359933:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4401, 64 off318944 00000040:00080000:2.0:1705683932.359937:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].381, 64 off32672 00000040:00080000:2.0:1705683932.359940:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4402, 64 off319008 00000040:00080000:2.0:1705683932.359943:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].382, 64 off32736 00000040:00080000:2.0:1705683932.359947:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4403, 64 off319072 00000040:00080000:2.0:1705683932.359974:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].384, 64 off32832 00000040:00080000:2.0:1705683932.359981:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4404, 64 off319136 00000040:00080000:2.0:1705683932.359985:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].385, 64 off32896 00000040:00080000:2.0:1705683932.359988:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4405, 64 off319200 00000040:00080000:2.0:1705683932.359992:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4406, 64 off319264 00000040:00080000:2.0:1705683932.359996:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].386, 64 off32960 00000040:00080000:2.0:1705683932.359999:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].387, 64 off33024 00000040:00080000:2.0:1705683932.360003:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].388, 64 off33088 00000040:00080000:2.0:1705683932.360006:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].389, 64 off33152 00000040:00080000:2.0:1705683932.360010:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].390, 64 off33216 00000040:00080000:2.0:1705683932.360013:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].391, 64 off33280 00000040:00080000:2.0:1705683932.360017:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].392, 64 off33344 00000040:00080000:2.0:1705683932.360020:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].393, 64 off33408 00000040:00080000:2.0:1705683932.360024:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].394, 64 off33472 00000040:00080000:2.0:1705683932.360027:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].395, 64 off33536 00000040:00080000:2.0:1705683932.360031:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].396, 64 off33600 00000040:00080000:2.0:1705683932.360034:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].397, 64 off33664 00000040:00080000:2.0:1705683932.360038:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].398, 64 off33728 00000040:00080000:2.0:1705683932.360042:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].399, 64 off33792 00000040:00080000:2.0:1705683932.360045:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].400, 64 off33856 00000040:00080000:2.0:1705683932.360049:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].401, 64 off33920 00000040:00080000:2.0:1705683932.360052:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].402, 64 off33984 00000040:00080000:2.0:1705683932.360056:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].403, 64 off34048 00000040:00080000:2.0:1705683932.360059:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].404, 64 off34112 00000040:00080000:2.0:1705683932.360062:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].405, 64 off34176 00000040:00080000:2.0:1705683932.360066:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].406, 64 off34240 00000040:00080000:2.0:1705683932.360069:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].407, 64 off34304 00000040:00080000:2.0:1705683932.360073:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].408, 64 off34368 00000040:00080000:2.0:1705683932.360076:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].409, 64 off34432 00000040:00080000:2.0:1705683932.360095:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].410, 64 off34496 00000040:00080000:2.0:1705683932.360099:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].411, 64 off34560 00000040:00080000:2.0:1705683932.360102:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].412, 64 off34624 00000040:00080000:2.0:1705683932.360106:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].413, 64 off34688 00000040:00080000:2.0:1705683932.360109:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].414, 64 off34752 00000040:00080000:2.0:1705683932.360113:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].415, 64 off34816 00000040:00080000:2.0:1705683932.360116:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].416, 64 off34880 00000040:00080000:2.0:1705683932.360120:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].417, 64 off34944 00000040:00080000:2.0:1705683932.360123:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].418, 64 off35008 00000040:00080000:2.0:1705683932.360127:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].419, 64 off35072 00000040:00080000:2.0:1705683932.360130:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].420, 64 off35136 00000040:00080000:2.0:1705683932.360134:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].421, 64 off35200 00000040:00080000:2.0:1705683932.360137:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].422, 64 off35264 00000040:00080000:2.0:1705683932.360140:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].423, 64 off35328 00000040:00080000:2.0:1705683932.360144:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].424, 64 off35392 00000040:00080000:2.0:1705683932.360147:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].425, 64 off35456 00000040:00080000:2.0:1705683932.360151:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].426, 64 off35520 00000040:00080000:2.0:1705683932.360154:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].427, 64 off35584 00000040:00080000:2.0:1705683932.360158:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].428, 64 off35648 00000040:00080000:2.0:1705683932.360161:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].429, 64 off35712 00000040:00080000:2.0:1705683932.360165:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].430, 64 off35776 00000040:00080000:2.0:1705683932.360168:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].431, 64 off35840 00000040:00080000:2.0:1705683932.360172:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].432, 64 off35904 00000040:00080000:2.0:1705683932.360176:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].433, 64 off35968 00000040:00080000:2.0:1705683932.360179:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].434, 64 off36032 00000040:00080000:2.0:1705683932.360182:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].435, 64 off36096 00000040:00080000:2.0:1705683932.360186:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].436, 64 off36160 00000040:00080000:2.0:1705683932.360189:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].437, 64 off36224 00000040:00080000:2.0:1705683932.360192:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].438, 64 off36288 00000040:00080000:2.0:1705683932.360196:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].439, 64 off36352 00000040:00080000:2.0:1705683932.360199:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].440, 64 off36416 00000040:00080000:2.0:1705683932.360202:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].441, 64 off36480 00000040:00080000:2.0:1705683932.360206:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].442, 64 off36544 00000040:00080000:2.0:1705683932.360209:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].443, 64 off36608 00000040:00080000:2.0:1705683932.360212:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].444, 64 off36672 00000040:00080000:2.0:1705683932.360216:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].445, 64 off36736 00000040:00080000:2.0:1705683932.360219:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].446, 64 off36800 00000040:00080000:2.0:1705683932.360223:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].447, 64 off36864 00000040:00080000:2.0:1705683932.360244:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].448, 64 off36928 00000040:00080000:2.0:1705683932.360251:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].449, 64 off36992 00000040:00080000:2.0:1705683932.360255:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].450, 64 off37056 00000040:00080000:2.0:1705683932.360259:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4407, 64 off319328 00000040:00080000:2.0:1705683932.360263:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].451, 64 off37120 00000040:00080000:2.0:1705683932.360266:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4408, 64 off319392 00000040:00080000:2.0:1705683932.360270:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].452, 64 off37184 00000040:00080000:2.0:1705683932.360273:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4409, 64 off319456 00000040:00080000:2.0:1705683932.360276:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].453, 64 off37248 00000040:00080000:2.0:1705683932.360296:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4411, 64 off319552 00010000:00010000:2.0:1705683932.360308:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.360310:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a71e00/0xefc4487a01877df1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360315:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880095a71e00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.360316:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a71e00/0xefc4487a01877df1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360319:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a71e00/0xefc4487a01877df1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360325:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a71e00/0xefc4487a01877df1 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360327:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a71e00/0xefc4487a01877df1 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360360:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.360362:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a72a80/0xefc4487a01877dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360364:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880095a72a80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.360365:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a72a80/0xefc4487a01877dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360367:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a72a80/0xefc4487a01877dff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360370:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a72a80/0xefc4487a01877dff lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360372:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a72a80/0xefc4487a01877dff lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360380:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360381:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360381:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360387:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.360396:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].454, 64 off37312 00000040:00080000:2.0:1705683932.360401:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4412, 64 off319616 00000040:00080000:2.0:1705683932.360405:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].455, 64 off37376 00000040:00080000:2.0:1705683932.360408:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4413, 64 off319680 00000040:00080000:2.0:1705683932.360412:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].456, 64 off37440 00000040:00080000:2.0:1705683932.360416:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4414, 64 off319744 00000040:00080000:2.0:1705683932.360419:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].457, 64 off37504 00000040:00080000:2.0:1705683932.360422:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4415, 64 off319808 00000040:00080000:2.0:1705683932.360426:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].458, 64 off37568 00000040:00080000:2.0:1705683932.360430:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4416, 64 off319872 00000040:00080000:2.0:1705683932.360433:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].459, 64 off37632 00000040:00080000:2.0:1705683932.360436:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4417, 64 off319936 00000040:00080000:2.0:1705683932.360440:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].460, 64 off37696 00000100:00100000:2.0:1705683932.360450:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360451:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360455:0:6520:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538640997312 00010000:00010000:2.0:1705683932.360462:0:6520:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c392080/0xefc4487a01859969 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86e5 expref: 6036 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.360475:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360476:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360478:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332711 00000100:00100000:2.0:1705683932.360480:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6036:1856:x1788538640997312:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1705683932.360484:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.360486:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c392080/0xefc4487a01859969 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8681:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86e5 expref: 6036 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.360490:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c392080/0xefc4487a01859969 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8681:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86e5 expref: 6036 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.360495:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c392080/0xefc4487a01859969 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8681:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86e5 expref: 6036 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.360500:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.360510:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6036:1856:x1788538640997312:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 29us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.360513:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332711 00000100:00100000:2.0:1705683932.360521:0:15173:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360521:0:15173:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360525:0:15173:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920515 00000100:00100000:2.0:1705683932.360527:0:15173:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007348a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+3088:3084:x1788538584478208:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.360566:0:15173:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9593:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.360567:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9593:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.360568:0:15173:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9593:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.360569:0:15173:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9593:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.360570:0:15173:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9593:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.360590:0:15173:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007348a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+3089:3084:x1788538584478208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (123us total) trans 4295348087 rc 0/0 00000100:00100000:2.0:1705683932.360593:0:15173:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920515 00010000:00010000:2.0:1705683932.360612:0:15223:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01859946 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f86c9 expref: 6034 pid: 14234 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.360621:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073749e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584476736:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.360625:0:15223:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aea1180/0xefc4487a018062fb lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x867f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1307 expref: 4077 pid: 14278 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.360630:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584476800:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.360639:0:15223:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.360642:0:15223:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.360642:0:15223:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.360642:0:15223:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.360643:0:15223:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360645:0:15223:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360648:0:15223:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360651:0:15223:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23bc00/0xefc4487a01877e06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x867f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360660:0:15223:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1705683932.360733:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3090:3081:x1788538584476480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3990us (4023us total) trans 4295348088 rc 0/0 00000100:00100000:2.0:1705683932.360738:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920498 00000100:00100000:2.0:1705683932.360744:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360745:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360747:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584478336 00000100:00100000:2.0:1705683932.360753:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360753:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360755:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920516 00000100:00100000:2.0:1705683932.360756:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3090:3081:x1788538584478336:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.360763:0:15223:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34437 count 1 00010000:00010000:2.0:1705683932.360827:0:15223:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360832:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801325f9400/0xefc4487a018063a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d13af expref: 4075 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.360836:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a3e800/0xefc4487a01859a26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f871d expref: 6033 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.360838:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.360839:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.360839:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360847:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a3e800/0xefc4487a01859a26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f871d expref: 6033 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.360851:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a3e800/0xefc4487a01859a26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f871d expref: 6033 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.360858:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584478464:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.360875:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801325f9400/0xefc4487a018063a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d13af expref: 4075 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.360879:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801325f9400/0xefc4487a018063a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d13af expref: 4075 pid: 15178 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.360883:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584478592:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.360889:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.360894:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.360903:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b039400/2, rc 0, transno 380793 00000100:00100000:2.0:1705683932.360906:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88007b039400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584477056:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.360910:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880133633700/2, rc 0, transno 380792 00000100:00100000:2.0:1705683932.360911:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133633700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584476480:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.360916:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.360918:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a72300/0xefc4487a01877e0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360921:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880095a72300 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.360922:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a72300/0xefc4487a01877e0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360925:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a72300/0xefc4487a01877e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360931:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a72300/0xefc4487a01877e0d lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360933:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a72300/0xefc4487a01877e0d lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360940:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.360941:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124051680/0xefc4487a01877e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360943:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124051680 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.360944:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124051680/0xefc4487a01877e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360946:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124051680/0xefc4487a01877e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360949:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124051680/0xefc4487a01877e29 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360951:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124051680/0xefc4487a01877e29 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.360955:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360956:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360956:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.360958:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.360961:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360961:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.360965:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920518 00000100:00100000:2.0:1705683932.360967:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3093:3082:x1788538584478528:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.361011:0:15131:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9594:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.361012:0:15131:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9594:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.361013:0:15131:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9594:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.361014:0:15131:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9594:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.361015:0:15131:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9594:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.361028:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3095:3082:x1788538584478528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 60us (131us total) trans 4295348092 rc 0/0 00000100:00100000:2.0:1705683932.361031:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920518 00000004:00080000:2.0:1705683932.361044:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081878a00/2, rc 0, transno 380796 00000100:00100000:2.0:1705683932.361045:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880081878a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584478528:0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.361051:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4418, 64 off320000 00000040:00080000:2.0:1705683932.361064:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].461, 64 off37760 00000040:00080000:2.0:1705683932.361070:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4419, 64 off320064 00000040:00080000:2.0:1705683932.361074:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].462, 64 off37824 00000040:00080000:2.0:1705683932.361094:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4420, 64 off320128 00000040:00080000:2.0:1705683932.361100:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].463, 64 off37888 00000040:00080000:2.0:1705683932.361135:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4421, 64 off320192 00000040:00080000:2.0:1705683932.361140:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].464, 64 off37952 00000040:00080000:2.0:1705683932.361144:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4422, 64 off320256 00000040:00080000:2.0:1705683932.361148:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].465, 64 off38016 00000040:00080000:2.0:1705683932.361152:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4423, 64 off320320 00000040:00080000:2.0:1705683932.361155:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].466, 64 off38080 00000040:00080000:2.0:1705683932.361159:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4424, 64 off320384 00000040:00080000:2.0:1705683932.361163:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].467, 64 off38144 00000040:00080000:2.0:1705683932.361167:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4425, 64 off320448 00000040:00080000:2.0:1705683932.361170:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].468, 64 off38208 00000040:00080000:2.0:1705683932.361174:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4426, 64 off320512 00000040:00080000:2.0:1705683932.361177:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].469, 64 off38272 00000040:00080000:2.0:1705683932.361181:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4427, 64 off320576 00000040:00080000:2.0:1705683932.361184:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].470, 64 off38336 00000040:00080000:2.0:1705683932.361188:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4428, 64 off320640 00000040:00080000:2.0:1705683932.361191:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].471, 64 off38400 00000040:00080000:2.0:1705683932.361195:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4429, 64 off320704 00000040:00080000:2.0:1705683932.361198:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].472, 64 off38464 00000040:00080000:2.0:1705683932.361202:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4430, 64 off320768 00000040:00080000:2.0:1705683932.361205:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].473, 64 off38528 00000040:00080000:2.0:1705683932.361209:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4431, 64 off320832 00000040:00080000:2.0:1705683932.361212:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].474, 64 off38592 00000040:00080000:2.0:1705683932.361216:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4432, 64 off320896 00000040:00080000:2.0:1705683932.361219:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].475, 64 off38656 00000040:00080000:2.0:1705683932.361223:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4433, 64 off320960 00000040:00080000:2.0:1705683932.361226:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].476, 64 off38720 00000040:00080000:2.0:1705683932.361230:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4434, 64 off321024 00000040:00080000:2.0:1705683932.361233:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].477, 64 off38784 00000040:00080000:2.0:1705683932.361237:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4435, 64 off321088 00000040:00080000:2.0:1705683932.361240:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].478, 64 off38848 00000040:00080000:2.0:1705683932.361243:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4436, 64 off321152 00000040:00080000:2.0:1705683932.361247:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].479, 64 off38912 00000040:00080000:2.0:1705683932.361250:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4437, 64 off321216 00000040:00080000:2.0:1705683932.361254:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].480, 64 off38976 00000040:00080000:2.0:1705683932.361257:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4438, 64 off321280 00000040:00080000:2.0:1705683932.361261:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].481, 64 off39040 00000040:00080000:2.0:1705683932.361264:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4439, 64 off321344 00000040:00080000:2.0:1705683932.361268:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].482, 64 off39104 00000040:00080000:2.0:1705683932.361271:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4440, 64 off321408 00000040:00080000:2.0:1705683932.361275:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].483, 64 off39168 00000040:00080000:2.0:1705683932.361279:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4441, 64 off321472 00000040:00080000:2.0:1705683932.361286:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].484, 64 off39232 00000040:00080000:2.0:1705683932.361293:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4442, 64 off321536 00000040:00080000:2.0:1705683932.361300:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].485, 64 off39296 00000040:00080000:2.0:1705683932.361306:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4443, 64 off321600 00000040:00080000:2.0:1705683932.361312:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].486, 64 off39360 00000040:00080000:2.0:1705683932.361319:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4444, 64 off321664 00000040:00080000:2.0:1705683932.361326:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].487, 64 off39424 00000040:00080000:2.0:1705683932.361332:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4445, 64 off321728 00000040:00080000:2.0:1705683932.361339:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].488, 64 off39488 00000040:00080000:2.0:1705683932.361348:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4446, 64 off321792 00000040:00080000:2.0:1705683932.361354:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].489, 64 off39552 00000040:00080000:2.0:1705683932.361361:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4447, 64 off321856 00000040:00080000:2.0:1705683932.361367:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].490, 64 off39616 00000040:00080000:2.0:1705683932.361372:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4448, 64 off321920 00000040:00080000:2.0:1705683932.361375:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].491, 64 off39680 00000040:00080000:2.0:1705683932.361379:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4449, 64 off321984 00000040:00080000:2.0:1705683932.361383:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].492, 64 off39744 00000040:00080000:2.0:1705683932.361386:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4450, 64 off322048 00000040:00080000:2.0:1705683932.361390:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].493, 64 off39808 00000040:00080000:2.0:1705683932.361394:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4451, 64 off322112 00000040:00080000:2.0:1705683932.361397:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].494, 64 off39872 00000040:00080000:2.0:1705683932.361400:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4452, 64 off322176 00000040:00080000:2.0:1705683932.361404:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].495, 64 off39936 00000040:00080000:2.0:1705683932.361407:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4453, 64 off322240 00000040:00080000:2.0:1705683932.361411:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].496, 64 off40000 00000040:00080000:2.0:1705683932.361414:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4454, 64 off322304 00000040:00080000:2.0:1705683932.361418:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].497, 64 off40064 00000040:00080000:2.0:1705683932.361421:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4455, 64 off322368 00000040:00080000:2.0:1705683932.361424:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].498, 64 off40128 00000040:00080000:2.0:1705683932.361428:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4456, 64 off322432 00000040:00080000:2.0:1705683932.361431:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].499, 64 off40192 00000040:00080000:2.0:1705683932.361435:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4457, 64 off322496 00000040:00080000:2.0:1705683932.361439:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].500, 64 off40256 00000040:00080000:2.0:1705683932.361442:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4458, 64 off322560 00000040:00080000:2.0:1705683932.361445:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].501, 64 off40320 00000040:00080000:2.0:1705683932.361449:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4459, 64 off322624 00000040:00080000:2.0:1705683932.361452:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].502, 64 off40384 00000040:00080000:2.0:1705683932.361456:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4460, 64 off322688 00000040:00080000:2.0:1705683932.361459:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].503, 64 off40448 00000040:00080000:2.0:1705683932.361462:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4461, 64 off322752 00000040:00080000:2.0:1705683932.361466:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].504, 64 off40512 00000040:00080000:2.0:1705683932.361469:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4462, 64 off322816 00000040:00080000:2.0:1705683932.361473:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].505, 64 off40576 00000040:00080000:2.0:1705683932.361476:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4463, 64 off322880 00000040:00080000:2.0:1705683932.361480:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].506, 64 off40640 00000040:00080000:2.0:1705683932.361483:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4464, 64 off322944 00000040:00080000:2.0:1705683932.361486:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].507, 64 off40704 00000040:00080000:2.0:1705683932.361490:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4465, 64 off323008 00000040:00080000:2.0:1705683932.361493:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].508, 64 off40768 00000040:00080000:2.0:1705683932.361497:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4466, 64 off323072 00000040:00080000:2.0:1705683932.361503:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].509, 64 off40832 00000040:00080000:2.0:1705683932.361509:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4467, 64 off323136 00000040:00080000:2.0:1705683932.361515:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].510, 64 off40896 00000040:00080000:2.0:1705683932.361521:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4468, 64 off323200 00000040:00080000:2.0:1705683932.361528:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].511, 64 off40960 00000040:00080000:2.0:1705683932.361535:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4469, 64 off323264 00000040:00080000:2.0:1705683932.361571:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].512, 64 off41024 00000040:00080000:2.0:1705683932.361579:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4470, 64 off323328 00000040:00080000:2.0:1705683932.361583:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].513, 64 off41088 00000040:00080000:2.0:1705683932.361587:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4471, 64 off323392 00000040:00080000:2.0:1705683932.361590:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].514, 64 off41152 00000040:00080000:2.0:1705683932.361594:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4472, 64 off323456 00000040:00080000:2.0:1705683932.361598:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].515, 64 off41216 00000040:00080000:2.0:1705683932.361601:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4473, 64 off323520 00000040:00080000:2.0:1705683932.361605:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].516, 64 off41280 00000040:00080000:2.0:1705683932.361609:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4474, 64 off323584 00000040:00080000:2.0:1705683932.361613:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].517, 64 off41344 00000040:00080000:2.0:1705683932.361633:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4475, 64 off323648 00000040:00080000:2.0:1705683932.361639:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].518, 64 off41408 00000040:00080000:2.0:1705683932.361643:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4476, 64 off323712 00000040:00080000:2.0:1705683932.361647:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].519, 64 off41472 00000040:00080000:2.0:1705683932.361651:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4477, 64 off323776 00000040:00080000:2.0:1705683932.361655:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].520, 64 off41536 00000040:00080000:2.0:1705683932.361658:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4478, 64 off323840 00000040:00080000:2.0:1705683932.361662:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].521, 64 off41600 00000040:00080000:2.0:1705683932.361665:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4479, 64 off323904 00000040:00080000:2.0:1705683932.361669:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].522, 64 off41664 00000040:00080000:2.0:1705683932.361672:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4480, 64 off323968 00000040:00080000:2.0:1705683932.361676:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].523, 64 off41728 00000040:00080000:2.0:1705683932.361679:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4481, 64 off324032 00000040:00080000:2.0:1705683932.361683:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].524, 64 off41792 00000040:00080000:2.0:1705683932.361686:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4482, 64 off324096 00000040:00080000:2.0:1705683932.361689:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].525, 64 off41856 00000040:00080000:2.0:1705683932.361693:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4483, 64 off324160 00000040:00080000:2.0:1705683932.361696:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].526, 64 off41920 00000040:00080000:2.0:1705683932.361700:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4484, 64 off324224 00000040:00080000:2.0:1705683932.361703:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].527, 64 off41984 00000040:00080000:2.0:1705683932.361706:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4485, 64 off324288 00000040:00080000:2.0:1705683932.361720:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].528, 64 off42048 00000040:00080000:2.0:1705683932.361725:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4486, 64 off324352 00000040:00080000:2.0:1705683932.361728:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].529, 64 off42112 00000040:00080000:2.0:1705683932.361732:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4487, 64 off324416 00000040:00080000:2.0:1705683932.361736:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].530, 64 off42176 00000040:00080000:2.0:1705683932.361740:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4488, 64 off324480 00000040:00080000:2.0:1705683932.361743:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].531, 64 off42240 00000040:00080000:2.0:1705683932.361746:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4489, 64 off324544 00000040:00080000:2.0:1705683932.361750:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].532, 64 off42304 00000040:00080000:2.0:1705683932.361754:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4490, 64 off324608 00000040:00080000:2.0:1705683932.361757:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].533, 64 off42368 00000040:00080000:2.0:1705683932.361761:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4491, 64 off324672 00000040:00080000:2.0:1705683932.361765:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 64 off42432 00000040:00080000:2.0:1705683932.361769:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4492, 64 off324736 00000040:00080000:2.0:1705683932.361773:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 64 off42496 00000040:00080000:2.0:1705683932.361776:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4493, 64 off324800 00000040:00080000:2.0:1705683932.361780:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 64 off42560 00000040:00080000:2.0:1705683932.361783:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4494, 64 off324864 00000040:00080000:2.0:1705683932.361786:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 64 off42624 00000040:00080000:2.0:1705683932.361790:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4495, 64 off324928 00000040:00080000:2.0:1705683932.361793:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 64 off42688 00000040:00080000:2.0:1705683932.361797:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4496, 64 off324992 00000040:00080000:2.0:1705683932.361801:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 64 off42752 00000040:00080000:2.0:1705683932.361804:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4497, 64 off325056 00000040:00080000:2.0:1705683932.361808:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].540, 64 off42816 00000040:00080000:2.0:1705683932.361811:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4498, 64 off325120 00000040:00080000:2.0:1705683932.361814:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].541, 64 off42880 00000040:00080000:2.0:1705683932.361818:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4499, 64 off325184 00000040:00080000:2.0:1705683932.361821:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].542, 64 off42944 00000040:00080000:2.0:1705683932.361825:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4500, 64 off325248 00000040:00080000:2.0:1705683932.361828:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].543, 64 off43008 00000040:00080000:2.0:1705683932.361832:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4501, 64 off325312 00000040:00080000:2.0:1705683932.361835:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].544, 64 off43072 00000040:00080000:2.0:1705683932.361839:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4502, 64 off325376 00000040:00080000:2.0:1705683932.361842:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].545, 64 off43136 00000040:00080000:2.0:1705683932.361846:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4503, 64 off325440 00000040:00080000:2.0:1705683932.361849:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].546, 64 off43200 00000040:00080000:2.0:1705683932.361853:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4504, 64 off325504 00000040:00080000:2.0:1705683932.361856:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].547, 64 off43264 00000040:00080000:2.0:1705683932.361860:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4505, 64 off325568 00000040:00080000:2.0:1705683932.361863:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].548, 64 off43328 00000040:00080000:2.0:1705683932.361867:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4506, 64 off325632 00000040:00080000:2.0:1705683932.361870:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].549, 64 off43392 00000040:00080000:2.0:1705683932.361874:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4507, 64 off325696 00000040:00080000:2.0:1705683932.361877:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].550, 64 off43456 00000040:00080000:2.0:1705683932.361880:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4508, 64 off325760 00000040:00080000:2.0:1705683932.361884:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].551, 64 off43520 00000040:00080000:2.0:1705683932.361887:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4509, 64 off325824 00000040:00080000:2.0:1705683932.361891:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].552, 64 off43584 00000040:00080000:2.0:1705683932.361894:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4510, 64 off325888 00000040:00080000:2.0:1705683932.361898:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].553, 64 off43648 00000040:00080000:2.0:1705683932.361901:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4511, 64 off325952 00000040:00080000:2.0:1705683932.361905:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].554, 64 off43712 00000040:00080000:2.0:1705683932.361908:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4512, 64 off326016 00000040:00080000:2.0:1705683932.361912:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].555, 64 off43776 00000040:00080000:2.0:1705683932.361915:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4513, 64 off326080 00000040:00080000:2.0:1705683932.361919:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].556, 64 off43840 00000040:00080000:2.0:1705683932.361922:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4514, 64 off326144 00000040:00080000:2.0:1705683932.361925:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].557, 64 off43904 00000040:00080000:2.0:1705683932.361929:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4515, 64 off326208 00000040:00080000:2.0:1705683932.361932:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].558, 64 off43968 00000040:00080000:2.0:1705683932.361936:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4516, 64 off326272 00000040:00080000:2.0:1705683932.361939:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].559, 64 off44032 00000040:00080000:2.0:1705683932.361943:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4517, 64 off326336 00000040:00080000:2.0:1705683932.361946:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].560, 64 off44096 00000040:00080000:2.0:1705683932.361950:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4518, 64 off326400 00000040:00080000:2.0:1705683932.361953:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].561, 64 off44160 00000040:00080000:2.0:1705683932.361956:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4519, 64 off326464 00000040:00080000:2.0:1705683932.361960:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].562, 64 off44224 00000040:00080000:2.0:1705683932.361963:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4520, 64 off326528 00000040:00080000:2.0:1705683932.361967:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].563, 64 off44288 00000040:00080000:2.0:1705683932.361970:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4521, 64 off326592 00000040:00080000:2.0:1705683932.361974:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].564, 64 off44352 00000040:00080000:2.0:1705683932.361977:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4522, 64 off326656 00000040:00080000:2.0:1705683932.361981:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].565, 64 off44416 00000040:00080000:2.0:1705683932.361984:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4523, 64 off326720 00000040:00080000:2.0:1705683932.361988:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].566, 64 off44480 00000040:00080000:2.0:1705683932.361991:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4524, 64 off326784 00000040:00080000:2.0:1705683932.361995:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].567, 64 off44544 00000040:00080000:2.0:1705683932.361998:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4525, 64 off326848 00000040:00080000:2.0:1705683932.362002:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].568, 64 off44608 00000040:00080000:2.0:1705683932.362005:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4526, 64 off326912 00000040:00080000:2.0:1705683932.362008:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].569, 64 off44672 00000040:00080000:2.0:1705683932.362012:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4527, 64 off326976 00000040:00080000:2.0:1705683932.362015:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].570, 64 off44736 00000040:00080000:2.0:1705683932.362019:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4528, 64 off327040 00000040:00080000:2.0:1705683932.362022:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].571, 64 off44800 00000040:00080000:2.0:1705683932.362025:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4529, 64 off327104 00000040:00080000:2.0:1705683932.362029:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].572, 64 off44864 00000040:00080000:2.0:1705683932.362033:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4530, 64 off327168 00000040:00080000:2.0:1705683932.362036:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].573, 64 off44928 00000040:00080000:2.0:1705683932.362039:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4531, 64 off327232 00000040:00080000:2.0:1705683932.362043:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].574, 64 off44992 00000040:00080000:2.0:1705683932.362046:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4532, 64 off327296 00000040:00080000:2.0:1705683932.362050:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].575, 64 off45056 00000040:00080000:2.0:1705683932.362053:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4533, 64 off327360 00000040:00080000:2.0:1705683932.362075:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].576, 64 off45120 00000040:00080000:2.0:1705683932.362097:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4534, 64 off327424 00000040:00080000:2.0:1705683932.362102:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].577, 64 off45184 00000040:00080000:2.0:1705683932.362106:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4535, 64 off327488 00000040:00080000:2.0:1705683932.362109:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].578, 64 off45248 00000040:00080000:2.0:1705683932.362113:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4536, 64 off327552 00000040:00080000:2.0:1705683932.362117:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].579, 64 off45312 00000040:00080000:2.0:1705683932.362121:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4537, 64 off327616 00000040:00080000:2.0:1705683932.362125:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].580, 64 off45376 00000040:00080000:2.0:1705683932.362129:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4538, 64 off327680 00000040:00080000:2.0:1705683932.362133:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].581, 64 off45440 00000040:00080000:2.0:1705683932.362153:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4539, 64 off327744 00000040:00080000:2.0:1705683932.362160:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].582, 64 off45504 00000040:00080000:2.0:1705683932.362164:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4540, 64 off327808 00000040:00080000:2.0:1705683932.362168:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].583, 64 off45568 00000040:00080000:2.0:1705683932.362172:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4541, 64 off327872 00000040:00080000:2.0:1705683932.362175:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].584, 64 off45632 00000040:00080000:2.0:1705683932.362179:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4542, 64 off327936 00000040:00080000:2.0:1705683932.362183:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].585, 64 off45696 00000040:00080000:2.0:1705683932.362186:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4543, 64 off328000 00000040:00080000:2.0:1705683932.362190:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].586, 64 off45760 00000040:00080000:2.0:1705683932.362193:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4544, 64 off328064 00000040:00080000:2.0:1705683932.362196:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].587, 64 off45824 00000040:00080000:2.0:1705683932.362200:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4545, 64 off328128 00000040:00080000:2.0:1705683932.362203:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].588, 64 off45888 00000040:00080000:2.0:1705683932.362207:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4546, 64 off328192 00000040:00080000:2.0:1705683932.362210:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].589, 64 off45952 00000040:00080000:2.0:1705683932.362214:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4547, 64 off328256 00000040:00080000:2.0:1705683932.362217:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].590, 64 off46016 00000040:00080000:2.0:1705683932.362221:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4548, 64 off328320 00000040:00080000:2.0:1705683932.362224:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].591, 64 off46080 00000040:00080000:2.0:1705683932.362227:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4549, 64 off328384 00000040:00080000:2.0:1705683932.362231:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].592, 64 off46144 00000040:00080000:2.0:1705683932.362234:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4550, 64 off328448 00000040:00080000:2.0:1705683932.362238:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].593, 64 off46208 00000040:00080000:2.0:1705683932.362242:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4551, 64 off328512 00000040:00080000:2.0:1705683932.362245:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].594, 64 off46272 00000040:00080000:2.0:1705683932.362248:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4552, 64 off328576 00000040:00080000:2.0:1705683932.362252:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].595, 64 off46336 00000040:00080000:2.0:1705683932.362255:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4553, 64 off328640 00000040:00080000:2.0:1705683932.362259:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].596, 64 off46400 00000040:00080000:2.0:1705683932.362263:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4554, 64 off328704 00000040:00080000:2.0:1705683932.362266:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].597, 64 off46464 00000040:00080000:2.0:1705683932.362270:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4555, 64 off328768 00000040:00080000:2.0:1705683932.362274:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].598, 64 off46528 00000040:00080000:2.0:1705683932.362277:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4556, 64 off328832 00000040:00080000:2.0:1705683932.362280:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].599, 64 off46592 00000040:00080000:2.0:1705683932.362284:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4557, 64 off328896 00000040:00080000:2.0:1705683932.362287:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].600, 64 off46656 00000040:00080000:2.0:1705683932.362290:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4558, 64 off328960 00000040:00080000:2.0:1705683932.362294:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].601, 64 off46720 00000040:00080000:2.0:1705683932.362297:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4559, 64 off329024 00000040:00080000:2.0:1705683932.362301:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].602, 64 off46784 00000040:00080000:2.0:1705683932.362304:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4560, 64 off329088 00000040:00080000:2.0:1705683932.362307:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].603, 64 off46848 00000040:00080000:2.0:1705683932.362311:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4561, 64 off329152 00000040:00080000:2.0:1705683932.362314:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].604, 64 off46912 00000040:00080000:2.0:1705683932.362317:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4562, 64 off329216 00000040:00080000:2.0:1705683932.362321:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].605, 64 off46976 00000040:00080000:2.0:1705683932.362324:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4563, 64 off329280 00000040:00080000:2.0:1705683932.362328:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].606, 64 off47040 00000040:00080000:2.0:1705683932.362331:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4564, 64 off329344 00000040:00080000:2.0:1705683932.362334:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].607, 64 off47104 00000040:00080000:2.0:1705683932.362338:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4565, 64 off329408 00000040:00080000:2.0:1705683932.362341:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].608, 64 off47168 00000040:00080000:2.0:1705683932.362345:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4566, 64 off329472 00000040:00080000:2.0:1705683932.362348:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].609, 64 off47232 00000040:00080000:2.0:1705683932.362351:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4567, 64 off329536 00000040:00080000:2.0:1705683932.362355:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].610, 64 off47296 00000040:00080000:2.0:1705683932.362359:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4568, 64 off329600 00000040:00080000:2.0:1705683932.362362:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].611, 64 off47360 00000040:00080000:2.0:1705683932.362365:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4569, 64 off329664 00000040:00080000:2.0:1705683932.362369:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].612, 64 off47424 00000040:00080000:2.0:1705683932.362372:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4570, 64 off329728 00000040:00080000:2.0:1705683932.362376:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].613, 64 off47488 00000040:00080000:2.0:1705683932.362379:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4571, 64 off329792 00000040:00080000:2.0:1705683932.362382:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].614, 64 off47552 00000040:00080000:2.0:1705683932.362386:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4572, 64 off329856 00000040:00080000:2.0:1705683932.362389:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].615, 64 off47616 00000040:00080000:2.0:1705683932.362393:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4573, 64 off329920 00000040:00080000:2.0:1705683932.362397:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].616, 64 off47680 00000040:00080000:2.0:1705683932.362400:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4574, 64 off329984 00000040:00080000:2.0:1705683932.362404:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].617, 64 off47744 00000040:00080000:2.0:1705683932.362407:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4575, 64 off330048 00000040:00080000:2.0:1705683932.362411:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].618, 64 off47808 00000040:00080000:2.0:1705683932.362414:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4576, 64 off330112 00000040:00080000:2.0:1705683932.362418:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].619, 64 off47872 00000040:00080000:2.0:1705683932.362421:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4577, 64 off330176 00000040:00080000:2.0:1705683932.362424:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].620, 64 off47936 00000040:00080000:2.0:1705683932.362428:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4578, 64 off330240 00000040:00080000:2.0:1705683932.362431:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].621, 64 off48000 00000040:00080000:2.0:1705683932.362434:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4579, 64 off330304 00000040:00080000:2.0:1705683932.362438:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].622, 64 off48064 00000040:00080000:2.0:1705683932.362441:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4580, 64 off330368 00000040:00080000:2.0:1705683932.362445:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].623, 64 off48128 00000040:00080000:2.0:1705683932.362449:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4581, 64 off330432 00000040:00080000:2.0:1705683932.362452:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].624, 64 off48192 00000040:00080000:2.0:1705683932.362456:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4582, 64 off330496 00000040:00080000:2.0:1705683932.362459:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].625, 64 off48256 00000040:00080000:2.0:1705683932.362463:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4583, 64 off330560 00000040:00080000:2.0:1705683932.362466:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].626, 64 off48320 00000040:00080000:2.0:1705683932.362470:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4584, 64 off330624 00000040:00080000:2.0:1705683932.362473:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].627, 64 off48384 00000040:00080000:2.0:1705683932.362476:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4585, 64 off330688 00000040:00080000:2.0:1705683932.362480:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].628, 64 off48448 00000040:00080000:2.0:1705683932.362483:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4586, 64 off330752 00000040:00080000:2.0:1705683932.362487:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].629, 64 off48512 00000040:00080000:2.0:1705683932.362490:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4587, 64 off330816 00000040:00080000:2.0:1705683932.362494:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].630, 64 off48576 00000040:00080000:2.0:1705683932.362497:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4588, 64 off330880 00000040:00080000:2.0:1705683932.362500:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].631, 64 off48640 00000040:00080000:2.0:1705683932.362504:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4589, 64 off330944 00000040:00080000:2.0:1705683932.362507:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].632, 64 off48704 00000040:00080000:2.0:1705683932.362511:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4590, 64 off331008 00000040:00080000:2.0:1705683932.362514:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].633, 64 off48768 00000040:00080000:2.0:1705683932.362518:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4591, 64 off331072 00000040:00080000:2.0:1705683932.362521:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].634, 64 off48832 00000040:00080000:2.0:1705683932.362525:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4592, 64 off331136 00000040:00080000:2.0:1705683932.362528:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].635, 64 off48896 00000040:00080000:2.0:1705683932.362532:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4593, 64 off331200 00000040:00080000:2.0:1705683932.362535:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].636, 64 off48960 00000040:00080000:2.0:1705683932.362539:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4594, 64 off331264 00000040:00080000:2.0:1705683932.362542:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].637, 64 off49024 00000040:00080000:2.0:1705683932.362546:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4595, 64 off331328 00000040:00080000:2.0:1705683932.362549:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].638, 64 off49088 00000040:00080000:2.0:1705683932.362553:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4596, 64 off331392 00000040:00080000:2.0:1705683932.362557:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].639, 64 off49152 00000040:00080000:2.0:1705683932.362561:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4597, 64 off331456 00000040:00080000:2.0:1705683932.362596:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].640, 64 off49216 00000040:00080000:2.0:1705683932.362603:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4598, 64 off331520 00000040:00080000:2.0:1705683932.362607:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].641, 64 off49280 00000040:00080000:2.0:1705683932.362611:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4599, 64 off331584 00000040:00080000:2.0:1705683932.362615:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].642, 64 off49344 00000040:00080000:2.0:1705683932.362618:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4600, 64 off331648 00000040:00080000:2.0:1705683932.362622:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].643, 64 off49408 00000040:00080000:2.0:1705683932.362625:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4601, 64 off331712 00000040:00080000:2.0:1705683932.362630:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].644, 64 off49472 00000040:00080000:2.0:1705683932.362634:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4602, 64 off331776 00000040:00080000:2.0:1705683932.362637:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].645, 64 off49536 00000040:00080000:2.0:1705683932.362656:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4603, 64 off331840 00000040:00080000:2.0:1705683932.362662:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].646, 64 off49600 00000040:00080000:2.0:1705683932.362666:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4604, 64 off331904 00000040:00080000:2.0:1705683932.362670:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].647, 64 off49664 00000040:00080000:2.0:1705683932.362674:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4605, 64 off331968 00000040:00080000:2.0:1705683932.362677:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].648, 64 off49728 00000040:00080000:2.0:1705683932.362681:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4606, 64 off332032 00000040:00080000:2.0:1705683932.362685:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].649, 64 off49792 00000040:00080000:2.0:1705683932.362688:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4607, 64 off332096 00000040:00080000:2.0:1705683932.362692:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].650, 64 off49856 00000040:00080000:2.0:1705683932.362696:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4608, 64 off332160 00000040:00080000:2.0:1705683932.362699:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].651, 64 off49920 00000040:00080000:2.0:1705683932.362703:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4609, 64 off332224 00000040:00080000:2.0:1705683932.362706:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].652, 64 off49984 00000040:00080000:2.0:1705683932.362726:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4610, 64 off332288 00000040:00080000:2.0:1705683932.362733:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].653, 64 off50048 00000040:00080000:2.0:1705683932.362740:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4611, 64 off332352 00000040:00080000:2.0:1705683932.362747:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].654, 64 off50112 00000040:00080000:2.0:1705683932.362753:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4612, 64 off332416 00000040:00080000:2.0:1705683932.362760:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].655, 64 off50176 00000040:00080000:2.0:1705683932.362767:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4613, 64 off332480 00000040:00080000:2.0:1705683932.362773:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].656, 64 off50240 00000040:00080000:2.0:1705683932.362780:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4614, 64 off332544 00000040:00080000:2.0:1705683932.362787:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].657, 64 off50304 00000040:00080000:2.0:1705683932.362794:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4615, 64 off332608 00000040:00080000:2.0:1705683932.362800:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].658, 64 off50368 00000040:00080000:2.0:1705683932.362807:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4616, 64 off332672 00000040:00080000:2.0:1705683932.362811:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].659, 64 off50432 00000040:00080000:2.0:1705683932.362815:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4617, 64 off332736 00000040:00080000:2.0:1705683932.362819:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].660, 64 off50496 00000040:00080000:2.0:1705683932.362823:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4618, 64 off332800 00000040:00080000:2.0:1705683932.362827:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].661, 64 off50560 00000040:00080000:2.0:1705683932.362830:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4619, 64 off332864 00000040:00080000:2.0:1705683932.362834:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].662, 64 off50624 00000040:00080000:2.0:1705683932.362837:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4620, 64 off332928 00000040:00080000:2.0:1705683932.362841:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].663, 64 off50688 00000040:00080000:2.0:1705683932.362844:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4621, 64 off332992 00000040:00080000:2.0:1705683932.362848:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].664, 64 off50752 00000040:00080000:2.0:1705683932.362851:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4622, 64 off333056 00000040:00080000:2.0:1705683932.362856:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].665, 64 off50816 00000040:00080000:2.0:1705683932.362859:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4623, 64 off333120 00000040:00080000:2.0:1705683932.362863:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].666, 64 off50880 00000040:00080000:2.0:1705683932.362866:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4624, 64 off333184 00000040:00080000:2.0:1705683932.362869:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].667, 64 off50944 00000040:00080000:2.0:1705683932.362873:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4625, 64 off333248 00000040:00080000:2.0:1705683932.362876:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].668, 64 off51008 00000040:00080000:2.0:1705683932.362880:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4626, 64 off333312 00000040:00080000:2.0:1705683932.362883:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].669, 64 off51072 00000040:00080000:2.0:1705683932.362887:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4627, 64 off333376 00000040:00080000:2.0:1705683932.362890:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].670, 64 off51136 00000040:00080000:2.0:1705683932.362894:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4628, 64 off333440 00000040:00080000:2.0:1705683932.362897:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].671, 64 off51200 00000040:00080000:2.0:1705683932.362901:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4629, 64 off333504 00000040:00080000:2.0:1705683932.362904:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].672, 64 off51264 00000040:00080000:2.0:1705683932.362908:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4630, 64 off333568 00000040:00080000:2.0:1705683932.362911:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].673, 64 off51328 00000040:00080000:2.0:1705683932.362915:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4631, 64 off333632 00000040:00080000:2.0:1705683932.362918:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].674, 64 off51392 00000040:00080000:2.0:1705683932.362922:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4632, 64 off333696 00000040:00080000:2.0:1705683932.362925:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].675, 64 off51456 00000040:00080000:2.0:1705683932.362929:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4633, 64 off333760 00000040:00080000:2.0:1705683932.362932:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].676, 64 off51520 00000040:00080000:2.0:1705683932.362936:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4634, 64 off333824 00000040:00080000:2.0:1705683932.362940:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].677, 64 off51584 00000040:00080000:2.0:1705683932.362943:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4635, 64 off333888 00000040:00080000:2.0:1705683932.362946:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].678, 64 off51648 00000040:00080000:2.0:1705683932.362950:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4636, 64 off333952 00000040:00080000:2.0:1705683932.362953:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].679, 64 off51712 00000040:00080000:2.0:1705683932.362957:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4637, 64 off334016 00000040:00080000:2.0:1705683932.362960:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].680, 64 off51776 00000040:00080000:2.0:1705683932.362963:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4638, 64 off334080 00000040:00080000:2.0:1705683932.362967:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].681, 64 off51840 00000040:00080000:2.0:1705683932.362970:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4639, 64 off334144 00000040:00080000:2.0:1705683932.362974:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].682, 64 off51904 00000040:00080000:2.0:1705683932.362977:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4640, 64 off334208 00000040:00080000:2.0:1705683932.362980:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].683, 64 off51968 00000040:00080000:2.0:1705683932.362984:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4641, 64 off334272 00000040:00080000:2.0:1705683932.362987:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].684, 64 off52032 00000040:00080000:2.0:1705683932.362991:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4642, 64 off334336 00000040:00080000:2.0:1705683932.362994:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].685, 64 off52096 00000040:00080000:2.0:1705683932.362997:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4643, 64 off334400 00000040:00080000:2.0:1705683932.363001:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].686, 64 off52160 00000040:00080000:2.0:1705683932.363005:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4644, 64 off334464 00000040:00080000:2.0:1705683932.363008:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].687, 64 off52224 00000040:00080000:2.0:1705683932.363012:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4645, 64 off334528 00000040:00080000:2.0:1705683932.363015:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].688, 64 off52288 00000040:00080000:2.0:1705683932.363019:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4646, 64 off334592 00000040:00080000:2.0:1705683932.363022:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].689, 64 off52352 00000040:00080000:2.0:1705683932.363026:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4647, 64 off334656 00000040:00080000:2.0:1705683932.363029:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].690, 64 off52416 00000040:00080000:2.0:1705683932.363032:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4648, 64 off334720 00000040:00080000:2.0:1705683932.363036:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].691, 64 off52480 00000040:00080000:2.0:1705683932.363039:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4649, 64 off334784 00000040:00080000:2.0:1705683932.363043:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].692, 64 off52544 00000040:00080000:2.0:1705683932.363046:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4650, 64 off334848 00000040:00080000:2.0:1705683932.363050:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].693, 64 off52608 00000040:00080000:2.0:1705683932.363053:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4651, 64 off334912 00000040:00080000:2.0:1705683932.363057:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].694, 64 off52672 00000040:00080000:2.0:1705683932.363060:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4652, 64 off334976 00000040:00080000:2.0:1705683932.363063:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].695, 64 off52736 00000040:00080000:2.0:1705683932.363067:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4653, 64 off335040 00000040:00080000:2.0:1705683932.363070:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].696, 64 off52800 00000040:00080000:2.0:1705683932.363074:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4654, 64 off335104 00000040:00080000:2.0:1705683932.363092:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].697, 64 off52864 00000040:00080000:2.0:1705683932.363097:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4655, 64 off335168 00000040:00080000:2.0:1705683932.363101:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].698, 64 off52928 00000040:00080000:2.0:1705683932.363105:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4656, 64 off335232 00000040:00080000:2.0:1705683932.363109:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].699, 64 off52992 00000040:00080000:2.0:1705683932.363112:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4657, 64 off335296 00000040:00080000:2.0:1705683932.363116:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].700, 64 off53056 00000040:00080000:2.0:1705683932.363119:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4658, 64 off335360 00000040:00080000:2.0:1705683932.363123:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].701, 64 off53120 00000040:00080000:2.0:1705683932.363126:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4659, 64 off335424 00000040:00080000:2.0:1705683932.363130:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].702, 64 off53184 00000040:00080000:2.0:1705683932.363133:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4660, 64 off335488 00000040:00080000:2.0:1705683932.363137:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].703, 64 off53248 00000040:00080000:2.0:1705683932.363140:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4661, 64 off335552 00010000:00010000:2.0:1705683932.363159:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.363161:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877e99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363165:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801314eb200 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.363166:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877e99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363172:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877e99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363178:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877e99 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363180:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a01877e99 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363188:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.363188:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.363189:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.363201:0:15223:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a3e800/0xefc4487a01859a26 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f871d expref: 6026 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.363206:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584478464:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.363211:0:15223:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801325f9400/0xefc4487a018063a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d13af expref: 4070 pid: 15178 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.363215:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584478592:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.363223:0:15223:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.363225:0:15223:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.363226:0:15223:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.363227:0:15223:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.363227:0:15223:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363230:0:15223:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363232:0:15223:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363235:0:15223:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01877ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363241:0:15223:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1705683932.363300:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3101:3081:x1788538584478336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2542us (2634us total) trans 4295348102 rc 0/0 00000100:00100000:2.0:1705683932.363303:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920516 00010000:00010000:2.0:1705683932.363312:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1705683932.363335:0:15218:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9595:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.363336:0:15218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9595:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.363336:0:15218:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9595:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.363337:0:15218:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9595:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.363337:0:15218:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9595:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.363348:0:15218:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8d5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+3100:3084:x1788538584478720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2377us (2406us total) trans 4295348093 rc 0/0 00000100:00100000:2.0:1705683932.363350:0:15218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920519 00000100:00100000:2.0:1705683932.363357:0:15218:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.363357:0:15218:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.363360:0:15218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920530 00000100:00100000:2.0:1705683932.363362:0:15218:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131dc6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+3101:3082:x1788538584480320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.363369:0:15218:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34444 count 1 00010000:00010000:2.0:1705683932.363426:0:15218:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363432:0:15218:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a581400/0xefc4487a0180647c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1465 expref: 4069 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.363435:0:15218:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800989da080/0xefc4487a01859a65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f877f expref: 6025 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.363438:0:15218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.363438:0:15218:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.363439:0:15218:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.363447:0:15218:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800989da080/0xefc4487a01859a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f877f expref: 6025 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.363451:0:15218:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800989da080/0xefc4487a01859a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f877f expref: 6025 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.363455:0:15218:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:15218:1788538584480640:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.363466:0:15218:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a581400/0xefc4487a0180647c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1465 expref: 4069 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.363469:0:15218:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a581400/0xefc4487a0180647c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x868c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1465 expref: 4069 pid: 15178 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.363476:0:15218:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:15218:1788538584480704:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.363480:0:15218:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33af00 going to sleep for 11 seconds 00000040:00080000:2.0:1705683932.363507:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].704, 64 off53312 00000040:00080000:2.0:1705683932.363517:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4662, 64 off335616 00000040:00080000:2.0:1705683932.363522:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].705, 64 off53376 00000040:00080000:2.0:1705683932.363526:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4663, 64 off335680 00000040:00080000:2.0:1705683932.363530:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].706, 64 off53440 00000040:00080000:2.0:1705683932.363534:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4664, 64 off335744 00000040:00080000:2.0:1705683932.363537:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].707, 64 off53504 00000040:00080000:2.0:1705683932.363541:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4665, 64 off335808 00000040:00080000:2.0:1705683932.363545:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].708, 64 off53568 00000040:00080000:2.0:1705683932.363549:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4666, 64 off335872 00000040:00080000:2.0:1705683932.363552:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].709, 64 off53632 00000040:00080000:2.0:1705683932.363574:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4667, 64 off335936 00000040:00080000:2.0:1705683932.363580:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].710, 64 off53696 00000040:00080000:2.0:1705683932.363584:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4668, 64 off336000 00000040:00080000:2.0:1705683932.363588:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].711, 64 off53760 00000040:00080000:2.0:1705683932.363592:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4669, 64 off336064 00000040:00080000:2.0:1705683932.363595:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].712, 64 off53824 00000040:00080000:2.0:1705683932.363599:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4670, 64 off336128 00000040:00080000:2.0:1705683932.363602:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].713, 64 off53888 00000040:00080000:2.0:1705683932.363606:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4671, 64 off336192 00000040:00080000:2.0:1705683932.363610:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].714, 64 off53952 00000040:00080000:2.0:1705683932.363613:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4672, 64 off336256 00000040:00080000:2.0:1705683932.363617:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].715, 64 off54016 00000040:00080000:2.0:1705683932.363620:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4673, 64 off336320 00000040:00080000:2.0:1705683932.363624:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].716, 64 off54080 00000040:00080000:2.0:1705683932.363627:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4674, 64 off336384 00000040:00080000:2.0:1705683932.363631:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].717, 64 off54144 00000040:00080000:2.0:1705683932.363635:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4675, 64 off336448 00000040:00080000:2.0:1705683932.363638:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].718, 64 off54208 00000040:00080000:2.0:1705683932.363642:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4676, 64 off336512 00000040:00080000:2.0:1705683932.363645:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].719, 64 off54272 00000040:00080000:2.0:1705683932.363649:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4677, 64 off336576 00000040:00080000:2.0:1705683932.363652:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].720, 64 off54336 00000040:00080000:2.0:1705683932.363656:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4678, 64 off336640 00000040:00080000:2.0:1705683932.363660:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].721, 64 off54400 00000040:00080000:2.0:1705683932.363663:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4679, 64 off336704 00000040:00080000:2.0:1705683932.363667:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].722, 64 off54464 00000040:00080000:2.0:1705683932.363670:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4680, 64 off336768 00000040:00080000:2.0:1705683932.363673:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].723, 64 off54528 00000040:00080000:2.0:1705683932.363677:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4681, 64 off336832 00000040:00080000:2.0:1705683932.363680:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].724, 64 off54592 00000040:00080000:2.0:1705683932.363684:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4682, 64 off336896 00000040:00080000:2.0:1705683932.363687:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].725, 64 off54656 00000040:00080000:2.0:1705683932.363691:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4683, 64 off336960 00000040:00080000:2.0:1705683932.363694:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].726, 64 off54720 00000040:00080000:2.0:1705683932.363698:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4684, 64 off337024 00000040:00080000:2.0:1705683932.363701:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].727, 64 off54784 00000040:00080000:2.0:1705683932.363705:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4685, 64 off337088 00000040:00080000:2.0:1705683932.363724:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].728, 64 off54848 00000040:00080000:2.0:1705683932.363728:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4686, 64 off337152 00000040:00080000:2.0:1705683932.363732:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].729, 64 off54912 00000040:00080000:2.0:1705683932.363736:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4687, 64 off337216 00000040:00080000:2.0:1705683932.363740:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].730, 64 off54976 00000040:00080000:2.0:1705683932.363743:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4688, 64 off337280 00000040:00080000:2.0:1705683932.363747:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].731, 64 off55040 00000040:00080000:2.0:1705683932.363750:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4689, 64 off337344 00000040:00080000:2.0:1705683932.363754:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].732, 64 off55104 00000040:00080000:2.0:1705683932.363757:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4690, 64 off337408 00000040:00080000:2.0:1705683932.363761:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].733, 64 off55168 00000040:00080000:2.0:1705683932.363765:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4691, 64 off337472 00000040:00080000:2.0:1705683932.363769:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].734, 64 off55232 00000040:00080000:2.0:1705683932.363773:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4692, 64 off337536 00000040:00080000:2.0:1705683932.363777:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].735, 64 off55296 00000040:00080000:2.0:1705683932.363780:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4693, 64 off337600 00000040:00080000:2.0:1705683932.363784:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].736, 64 off55360 00000040:00080000:2.0:1705683932.363788:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4694, 64 off337664 00000040:00080000:2.0:1705683932.363791:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].737, 64 off55424 00000040:00080000:2.0:1705683932.363795:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4695, 64 off337728 00000040:00080000:2.0:1705683932.363798:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].738, 64 off55488 00000040:00080000:2.0:1705683932.363802:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4696, 64 off337792 00000040:00080000:2.0:1705683932.363806:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].739, 64 off55552 00000040:00080000:2.0:1705683932.363809:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4697, 64 off337856 00000040:00080000:2.0:1705683932.363813:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].740, 64 off55616 00000040:00080000:2.0:1705683932.363817:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4698, 64 off337920 00000040:00080000:2.0:1705683932.363820:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].741, 64 off55680 00000040:00080000:2.0:1705683932.363823:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4699, 64 off337984 00000040:00080000:2.0:1705683932.363827:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].742, 64 off55744 00000040:00080000:2.0:1705683932.363830:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4700, 64 off338048 00000040:00080000:2.0:1705683932.363834:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].743, 64 off55808 00000040:00080000:2.0:1705683932.363837:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4701, 64 off338112 00000040:00080000:2.0:1705683932.363841:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].744, 64 off55872 00000040:00080000:2.0:1705683932.363844:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4702, 64 off338176 00000040:00080000:2.0:1705683932.363848:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].745, 64 off55936 00000040:00080000:2.0:1705683932.363851:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4703, 64 off338240 00000040:00080000:2.0:1705683932.363854:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].746, 64 off56000 00000040:00080000:2.0:1705683932.363858:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4704, 64 off338304 00000040:00080000:2.0:1705683932.363861:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].747, 64 off56064 00000040:00080000:2.0:1705683932.363865:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4705, 64 off338368 00000040:00080000:2.0:1705683932.363868:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].748, 64 off56128 00000040:00080000:2.0:1705683932.363872:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4706, 64 off338432 00000040:00080000:2.0:1705683932.363876:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].749, 64 off56192 00000040:00080000:2.0:1705683932.363879:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4707, 64 off338496 00000040:00080000:2.0:1705683932.363883:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].750, 64 off56256 00000040:00080000:2.0:1705683932.363886:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4708, 64 off338560 00000040:00080000:2.0:1705683932.363890:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].751, 64 off56320 00000040:00080000:2.0:1705683932.363893:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4709, 64 off338624 00000040:00080000:2.0:1705683932.363897:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].752, 64 off56384 00000040:00080000:2.0:1705683932.363900:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4710, 64 off338688 00000040:00080000:2.0:1705683932.363904:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].753, 64 off56448 00000040:00080000:2.0:1705683932.363907:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4711, 64 off338752 00000040:00080000:2.0:1705683932.363911:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].754, 64 off56512 00000040:00080000:2.0:1705683932.363914:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4712, 64 off338816 00000040:00080000:2.0:1705683932.363917:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].755, 64 off56576 00000040:00080000:2.0:1705683932.363921:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4713, 64 off338880 00000040:00080000:2.0:1705683932.363924:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].756, 64 off56640 00000040:00080000:2.0:1705683932.363928:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4714, 64 off338944 00000040:00080000:2.0:1705683932.363931:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].757, 64 off56704 00000040:00080000:2.0:1705683932.363935:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4715, 64 off339008 00000040:00080000:2.0:1705683932.363938:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].758, 64 off56768 00000040:00080000:2.0:1705683932.363941:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4716, 64 off339072 00000040:00080000:2.0:1705683932.363945:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].759, 64 off56832 00000040:00080000:2.0:1705683932.363948:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4717, 64 off339136 00000040:00080000:2.0:1705683932.363952:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].760, 64 off56896 00000040:00080000:2.0:1705683932.363955:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4718, 64 off339200 00000040:00080000:2.0:1705683932.363958:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].761, 64 off56960 00000040:00080000:2.0:1705683932.363962:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4719, 64 off339264 00000040:00080000:2.0:1705683932.363965:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].762, 64 off57024 00000040:00080000:2.0:1705683932.363969:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4720, 64 off339328 00000040:00080000:2.0:1705683932.363972:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].763, 64 off57088 00000040:00080000:2.0:1705683932.363975:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4721, 64 off339392 00000040:00080000:2.0:1705683932.363979:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].764, 64 off57152 00000040:00080000:2.0:1705683932.363982:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4722, 64 off339456 00000040:00080000:2.0:1705683932.363986:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].765, 64 off57216 00000040:00080000:2.0:1705683932.363989:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4723, 64 off339520 00000040:00080000:2.0:1705683932.363993:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].766, 64 off57280 00000040:00080000:2.0:1705683932.363996:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4724, 64 off339584 00000040:00080000:2.0:1705683932.364000:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].767, 64 off57344 00000040:00080000:2.0:1705683932.364003:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4725, 64 off339648 00000040:00080000:2.0:1705683932.364025:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].768, 64 off57408 00000040:00080000:2.0:1705683932.364032:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4726, 64 off339712 00000040:00080000:2.0:1705683932.364036:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].769, 64 off57472 00000040:00080000:2.0:1705683932.364040:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4727, 64 off339776 00000040:00080000:2.0:1705683932.364044:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].770, 64 off57536 00000040:00080000:2.0:1705683932.364048:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4728, 64 off339840 00000040:00080000:2.0:1705683932.364051:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].771, 64 off57600 00000040:00080000:2.0:1705683932.364055:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4729, 64 off339904 00000040:00080000:2.0:1705683932.364059:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].772, 64 off57664 00000040:00080000:2.0:1705683932.364062:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4730, 64 off339968 00000040:00080000:2.0:1705683932.364066:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].773, 64 off57728 00000040:00080000:2.0:1705683932.364105:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4731, 64 off340032 00000040:00080000:2.0:1705683932.364117:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].774, 64 off57792 00000040:00080000:2.0:1705683932.364124:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4732, 64 off340096 00000040:00080000:2.0:1705683932.364131:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].775, 64 off57856 00000040:00080000:2.0:1705683932.364137:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4733, 64 off340160 00000040:00080000:2.0:1705683932.364144:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].776, 64 off57920 00000040:00080000:2.0:1705683932.364151:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4734, 64 off340224 00000040:00080000:2.0:1705683932.364157:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].777, 64 off57984 00000040:00080000:2.0:1705683932.364165:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4735, 64 off340288 00000040:00080000:2.0:1705683932.364172:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].778, 64 off58048 00000040:00080000:2.0:1705683932.364178:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4736, 64 off340352 00000040:00080000:2.0:1705683932.364183:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].779, 64 off58112 00000040:00080000:2.0:1705683932.364186:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4737, 64 off340416 00000040:00080000:2.0:1705683932.364190:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].780, 64 off58176 00000040:00080000:2.0:1705683932.364194:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4738, 64 off340480 00000040:00080000:2.0:1705683932.364197:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].781, 64 off58240 00000040:00080000:2.0:1705683932.364201:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4739, 64 off340544 00000040:00080000:2.0:1705683932.364205:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].782, 64 off58304 00000040:00080000:2.0:1705683932.364208:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4740, 64 off340608 00000040:00080000:2.0:1705683932.364212:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].783, 64 off58368 00000040:00080000:2.0:1705683932.364215:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4741, 64 off340672 00000040:00080000:2.0:1705683932.364218:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].784, 64 off58432 00000040:00080000:2.0:1705683932.364222:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4742, 64 off340736 00000040:00080000:2.0:1705683932.364225:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].785, 64 off58496 00000040:00080000:2.0:1705683932.364229:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4743, 64 off340800 00000040:00080000:2.0:1705683932.364232:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].786, 64 off58560 00000040:00080000:2.0:1705683932.364235:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4744, 64 off340864 00000040:00080000:2.0:1705683932.364239:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].787, 64 off58624 00000040:00080000:2.0:1705683932.364242:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4745, 64 off340928 00000040:00080000:2.0:1705683932.364246:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].788, 64 off58688 00000040:00080000:2.0:1705683932.364249:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4746, 64 off340992 00000040:00080000:2.0:1705683932.364252:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].789, 64 off58752 00000040:00080000:2.0:1705683932.364256:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4747, 64 off341056 00000040:00080000:2.0:1705683932.364259:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].790, 64 off58816 00000040:00080000:2.0:1705683932.364263:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4748, 64 off341120 00000040:00080000:2.0:1705683932.364266:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].791, 64 off58880 00000040:00080000:2.0:1705683932.364269:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4749, 64 off341184 00000040:00080000:2.0:1705683932.364273:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].792, 64 off58944 00000040:00080000:2.0:1705683932.364277:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4750, 64 off341248 00000040:00080000:2.0:1705683932.364282:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].793, 64 off59008 00000040:00080000:2.0:1705683932.364289:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4751, 64 off341312 00000040:00080000:2.0:1705683932.364294:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].794, 64 off59072 00000040:00080000:2.0:1705683932.364301:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4752, 64 off341376 00000040:00080000:2.0:1705683932.364307:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].795, 64 off59136 00000040:00080000:2.0:1705683932.364314:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4753, 64 off341440 00000040:00080000:2.0:1705683932.364320:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].796, 64 off59200 00000040:00080000:2.0:1705683932.364327:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4754, 64 off341504 00000040:00080000:2.0:1705683932.364334:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].797, 64 off59264 00000040:00080000:2.0:1705683932.364339:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4755, 64 off341568 00000040:00080000:2.0:1705683932.364343:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].798, 64 off59328 00000040:00080000:2.0:1705683932.364346:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4756, 64 off341632 00000040:00080000:2.0:1705683932.364350:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].799, 64 off59392 00000040:00080000:2.0:1705683932.364353:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4757, 64 off341696 00000040:00080000:2.0:1705683932.364357:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].800, 64 off59456 00000040:00080000:2.0:1705683932.364361:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4758, 64 off341760 00000040:00080000:2.0:1705683932.364364:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].801, 64 off59520 00000040:00080000:2.0:1705683932.364368:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4759, 64 off341824 00000040:00080000:2.0:1705683932.364371:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].802, 64 off59584 00000040:00080000:2.0:1705683932.364375:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4760, 64 off341888 00000040:00080000:2.0:1705683932.364378:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].803, 64 off59648 00000040:00080000:2.0:1705683932.364381:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4761, 64 off341952 00000040:00080000:2.0:1705683932.364385:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].804, 64 off59712 00000040:00080000:2.0:1705683932.364388:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4762, 64 off342016 00000040:00080000:2.0:1705683932.364392:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].805, 64 off59776 00000040:00080000:2.0:1705683932.364395:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4763, 64 off342080 00000040:00080000:2.0:1705683932.364399:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].806, 64 off59840 00000040:00080000:2.0:1705683932.364402:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4764, 64 off342144 00000040:00080000:2.0:1705683932.364405:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].807, 64 off59904 00000040:00080000:2.0:1705683932.364409:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4765, 64 off342208 00000040:00080000:2.0:1705683932.364412:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].808, 64 off59968 00000040:00080000:2.0:1705683932.364415:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4766, 64 off342272 00000040:00080000:2.0:1705683932.364420:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].809, 64 off60032 00000040:00080000:2.0:1705683932.364423:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4767, 64 off342336 00000040:00080000:2.0:1705683932.364427:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].810, 64 off60096 00000040:00080000:2.0:1705683932.364430:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4768, 64 off342400 00000040:00080000:2.0:1705683932.364434:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].811, 64 off60160 00000040:00080000:2.0:1705683932.364437:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4769, 64 off342464 00000040:00080000:2.0:1705683932.364441:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].812, 64 off60224 00000040:00080000:2.0:1705683932.364444:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4770, 64 off342528 00000040:00080000:2.0:1705683932.364447:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].813, 64 off60288 00000040:00080000:2.0:1705683932.364451:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4771, 64 off342592 00000040:00080000:2.0:1705683932.364454:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].814, 64 off60352 00000040:00080000:2.0:1705683932.364458:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4772, 64 off342656 00000040:00080000:2.0:1705683932.364461:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].815, 64 off60416 00000040:00080000:2.0:1705683932.364464:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4773, 64 off342720 00000040:00080000:2.0:1705683932.364468:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].816, 64 off60480 00000040:00080000:2.0:1705683932.364471:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4774, 64 off342784 00000040:00080000:2.0:1705683932.364474:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].817, 64 off60544 00000040:00080000:2.0:1705683932.364478:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4775, 64 off342848 00000040:00080000:2.0:1705683932.364481:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].818, 64 off60608 00000040:00080000:2.0:1705683932.364485:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4776, 64 off342912 00000040:00080000:2.0:1705683932.364488:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].819, 64 off60672 00000040:00080000:2.0:1705683932.364491:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4777, 64 off342976 00000040:00080000:2.0:1705683932.364495:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].820, 64 off60736 00000040:00080000:2.0:1705683932.364498:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4778, 64 off343040 00000040:00080000:2.0:1705683932.364501:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].821, 64 off60800 00000040:00080000:2.0:1705683932.364505:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4779, 64 off343104 00000040:00080000:2.0:1705683932.364508:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].822, 64 off60864 00000040:00080000:2.0:1705683932.364512:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4780, 64 off343168 00000040:00080000:2.0:1705683932.364515:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].823, 64 off60928 00000040:00080000:2.0:1705683932.364518:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4781, 64 off343232 00000040:00080000:2.0:1705683932.364522:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].824, 64 off60992 00000040:00080000:2.0:1705683932.364525:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4782, 64 off343296 00000040:00080000:2.0:1705683932.364528:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].825, 64 off61056 00000040:00080000:2.0:1705683932.364532:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4783, 64 off343360 00000040:00080000:2.0:1705683932.364535:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].826, 64 off61120 00000040:00080000:2.0:1705683932.364539:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4784, 64 off343424 00000040:00080000:2.0:1705683932.364542:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].827, 64 off61184 00000040:00080000:2.0:1705683932.364545:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4785, 64 off343488 00000040:00080000:2.0:1705683932.364549:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].828, 64 off61248 00000040:00080000:2.0:1705683932.364552:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4786, 64 off343552 00000040:00080000:2.0:1705683932.364555:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].829, 64 off61312 00000040:00080000:2.0:1705683932.364559:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4787, 64 off343616 00000040:00080000:2.0:1705683932.364562:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].830, 64 off61376 00000040:00080000:2.0:1705683932.364566:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4788, 64 off343680 00000040:00080000:2.0:1705683932.364569:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].831, 64 off61440 00000040:00080000:2.0:1705683932.364572:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4789, 64 off343744 00000040:00080000:2.0:1705683932.364596:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].832, 64 off61504 00000040:00080000:2.0:1705683932.364603:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4790, 64 off343808 00000040:00080000:2.0:1705683932.364607:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].833, 64 off61568 00000040:00080000:2.0:1705683932.364611:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4791, 64 off343872 00000040:00080000:2.0:1705683932.364614:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].834, 64 off61632 00000040:00080000:2.0:1705683932.364618:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4792, 64 off343936 00000040:00080000:2.0:1705683932.364622:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].835, 64 off61696 00000040:00080000:2.0:1705683932.364625:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4793, 64 off344000 00000040:00080000:2.0:1705683932.364629:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].836, 64 off61760 00000040:00080000:2.0:1705683932.364632:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4794, 64 off344064 00000040:00080000:2.0:1705683932.364636:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].837, 64 off61824 00000040:00080000:2.0:1705683932.364653:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4795, 64 off344128 00000040:00080000:2.0:1705683932.364659:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].838, 64 off61888 00000040:00080000:2.0:1705683932.364663:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4796, 64 off344192 00000040:00080000:2.0:1705683932.364667:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].839, 64 off61952 00000040:00080000:2.0:1705683932.364670:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4797, 64 off344256 00000040:00080000:2.0:1705683932.364674:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].840, 64 off62016 00000040:00080000:2.0:1705683932.364678:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4798, 64 off344320 00000040:00080000:2.0:1705683932.364681:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].841, 64 off62080 00000040:00080000:2.0:1705683932.364685:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4799, 64 off344384 00000040:00080000:2.0:1705683932.364688:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].842, 64 off62144 00000040:00080000:2.0:1705683932.364692:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4800, 64 off344448 00000040:00080000:2.0:1705683932.364695:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].843, 64 off62208 00000040:00080000:2.0:1705683932.364699:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4801, 64 off344512 00000040:00080000:2.0:1705683932.364702:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].844, 64 off62272 00000040:00080000:2.0:1705683932.364706:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4802, 64 off344576 00000040:00080000:2.0:1705683932.364722:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].845, 64 off62336 00000040:00080000:2.0:1705683932.364726:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4803, 64 off344640 00000040:00080000:2.0:1705683932.364730:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].846, 64 off62400 00000040:00080000:2.0:1705683932.364734:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4804, 64 off344704 00000040:00080000:2.0:1705683932.364737:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].847, 64 off62464 00000040:00080000:2.0:1705683932.364741:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4805, 64 off344768 00000040:00080000:2.0:1705683932.364745:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].848, 64 off62528 00000040:00080000:2.0:1705683932.364748:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4806, 64 off344832 00000040:00080000:2.0:1705683932.364752:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].849, 64 off62592 00000040:00080000:2.0:1705683932.364755:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4807, 64 off344896 00000040:00080000:2.0:1705683932.364759:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].850, 64 off62656 00000040:00080000:2.0:1705683932.364762:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4808, 64 off344960 00000040:00080000:2.0:1705683932.364765:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].851, 64 off62720 00000040:00080000:2.0:1705683932.364769:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4809, 64 off345024 00000040:00080000:2.0:1705683932.364772:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].852, 64 off62784 00000040:00080000:2.0:1705683932.364776:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4810, 64 off345088 00000040:00080000:2.0:1705683932.364779:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].853, 64 off62848 00000040:00080000:2.0:1705683932.364783:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4811, 64 off345152 00000040:00080000:2.0:1705683932.364786:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].854, 64 off62912 00000040:00080000:2.0:1705683932.364789:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4812, 64 off345216 00000040:00080000:2.0:1705683932.364793:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].855, 64 off62976 00000040:00080000:2.0:1705683932.364796:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4813, 64 off345280 00000040:00080000:2.0:1705683932.364800:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].856, 64 off63040 00000040:00080000:2.0:1705683932.364803:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4814, 64 off345344 00000040:00080000:2.0:1705683932.364807:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].857, 64 off63104 00000040:00080000:2.0:1705683932.364810:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4815, 64 off345408 00000040:00080000:2.0:1705683932.364813:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].858, 64 off63168 00000040:00080000:2.0:1705683932.364817:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4816, 64 off345472 00000040:00080000:2.0:1705683932.364820:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].859, 64 off63232 00000040:00080000:2.0:1705683932.364824:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4817, 64 off345536 00000040:00080000:2.0:1705683932.364827:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].860, 64 off63296 00000040:00080000:2.0:1705683932.364831:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4818, 64 off345600 00000040:00080000:2.0:1705683932.364834:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].861, 64 off63360 00000040:00080000:2.0:1705683932.364838:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4819, 64 off345664 00000040:00080000:2.0:1705683932.364841:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].862, 64 off63424 00000040:00080000:2.0:1705683932.364845:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4820, 64 off345728 00000040:00080000:2.0:1705683932.364848:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].863, 64 off63488 00000040:00080000:2.0:1705683932.364852:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4821, 64 off345792 00000040:00080000:2.0:1705683932.364855:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].864, 64 off63552 00000040:00080000:2.0:1705683932.364858:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4822, 64 off345856 00000040:00080000:2.0:1705683932.364862:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].865, 64 off63616 00000040:00080000:2.0:1705683932.364865:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4823, 64 off345920 00000040:00080000:2.0:1705683932.364869:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].866, 64 off63680 00000040:00080000:2.0:1705683932.364872:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4824, 64 off345984 00000040:00080000:2.0:1705683932.364875:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].867, 64 off63744 00000040:00080000:2.0:1705683932.364879:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4825, 64 off346048 00000040:00080000:2.0:1705683932.364882:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].868, 64 off63808 00000040:00080000:2.0:1705683932.364886:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4826, 64 off346112 00000040:00080000:2.0:1705683932.364889:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].869, 64 off63872 00000040:00080000:2.0:1705683932.364893:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4827, 64 off346176 00000040:00080000:2.0:1705683932.364896:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].870, 64 off63936 00000040:00080000:2.0:1705683932.364899:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4828, 64 off346240 00000040:00080000:2.0:1705683932.364903:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].871, 64 off64000 00000040:00080000:2.0:1705683932.364906:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4829, 64 off346304 00000040:00080000:2.0:1705683932.364909:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].872, 64 off64064 00000040:00080000:2.0:1705683932.364913:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4830, 64 off346368 00000040:00080000:2.0:1705683932.364917:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].873, 64 off64128 00000040:00080000:2.0:1705683932.364920:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4831, 64 off346432 00000040:00080000:2.0:1705683932.364923:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].874, 64 off64192 00000040:00080000:2.0:1705683932.364927:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4832, 64 off346496 00000040:00080000:2.0:1705683932.364930:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].875, 64 off64256 00000040:00080000:2.0:1705683932.364934:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4833, 64 off346560 00000040:00080000:2.0:1705683932.364937:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].876, 64 off64320 00000040:00080000:2.0:1705683932.364940:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4834, 64 off346624 00000040:00080000:2.0:1705683932.364944:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].877, 64 off64384 00000040:00080000:2.0:1705683932.364948:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4835, 64 off346688 00000040:00080000:2.0:1705683932.364951:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].878, 64 off64448 00000040:00080000:2.0:1705683932.364955:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4836, 64 off346752 00000040:00080000:2.0:1705683932.364958:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].879, 64 off64512 00000040:00080000:2.0:1705683932.364961:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4837, 64 off346816 00000040:00080000:2.0:1705683932.364965:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].880, 64 off64576 00000040:00080000:2.0:1705683932.364968:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4838, 64 off346880 00000040:00080000:2.0:1705683932.364971:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].881, 64 off64640 00000040:00080000:2.0:1705683932.364975:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4839, 64 off346944 00000040:00080000:2.0:1705683932.364978:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].882, 64 off64704 00000040:00080000:2.0:1705683932.364982:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4840, 64 off347008 00000040:00080000:2.0:1705683932.364985:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].883, 64 off64768 00000040:00080000:2.0:1705683932.364988:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4841, 64 off347072 00000040:00080000:2.0:1705683932.364992:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].884, 64 off64832 00000040:00080000:2.0:1705683932.364995:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4842, 64 off347136 00000040:00080000:2.0:1705683932.364999:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].885, 64 off64896 00000040:00080000:2.0:1705683932.365002:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4843, 64 off347200 00000040:00080000:2.0:1705683932.365006:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].886, 64 off64960 00000040:00080000:2.0:1705683932.365009:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4844, 64 off347264 00000040:00080000:2.0:1705683932.365012:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].887, 64 off65024 00000040:00080000:2.0:1705683932.365016:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4845, 64 off347328 00000040:00080000:2.0:1705683932.365019:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].888, 64 off65088 00000040:00080000:2.0:1705683932.365022:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4846, 64 off347392 00000040:00080000:2.0:1705683932.365026:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].889, 64 off65152 00000040:00080000:2.0:1705683932.365029:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4847, 64 off347456 00000040:00080000:2.0:1705683932.365033:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].890, 64 off65216 00000040:00080000:2.0:1705683932.365036:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4848, 64 off347520 00000040:00080000:2.0:1705683932.365039:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].891, 64 off65280 00000040:00080000:2.0:1705683932.365043:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4849, 64 off347584 00000040:00080000:2.0:1705683932.365046:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].892, 64 off65344 00000040:00080000:2.0:1705683932.365050:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4850, 64 off347648 00000040:00080000:2.0:1705683932.365053:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].893, 64 off65408 00000040:00080000:2.0:1705683932.365057:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4851, 64 off347712 00000040:00080000:2.0:1705683932.365060:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].894, 64 off65472 00000040:00080000:2.0:1705683932.365064:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4852, 64 off347776 00000040:00080000:2.0:1705683932.365067:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].895, 64 off65536 00000040:00080000:2.0:1705683932.365071:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4853, 64 off347840 00000040:00080000:2.0:1705683932.365107:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].896, 64 off65600 00000040:00080000:2.0:1705683932.365115:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4854, 64 off347904 00000040:00080000:2.0:1705683932.365119:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].897, 64 off65664 00000040:00080000:2.0:1705683932.365123:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4855, 64 off347968 00000040:00080000:2.0:1705683932.365127:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].898, 64 off65728 00000040:00080000:2.0:1705683932.365131:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4856, 64 off348032 00000040:00080000:2.0:1705683932.365134:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].899, 64 off65792 00000040:00080000:2.0:1705683932.365138:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4857, 64 off348096 00000040:00080000:2.0:1705683932.365141:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].900, 64 off65856 00000040:00080000:2.0:1705683932.365145:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4858, 64 off348160 00000040:00080000:2.0:1705683932.365148:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].901, 64 off65920 00000040:00080000:2.0:1705683932.365167:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4859, 64 off348224 00000040:00080000:2.0:1705683932.365173:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].902, 64 off65984 00000040:00080000:2.0:1705683932.365177:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4860, 64 off348288 00000040:00080000:2.0:1705683932.365181:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].903, 64 off66048 00000040:00080000:2.0:1705683932.365185:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4861, 64 off348352 00000040:00080000:2.0:1705683932.365188:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].904, 64 off66112 00000040:00080000:2.0:1705683932.365192:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4862, 64 off348416 00000040:00080000:2.0:1705683932.365195:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].905, 64 off66176 00000040:00080000:2.0:1705683932.365201:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4863, 64 off348480 00000040:00080000:2.0:1705683932.365207:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].906, 64 off66240 00000040:00080000:2.0:1705683932.365214:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4864, 64 off348544 00000040:00080000:2.0:1705683932.365220:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].907, 64 off66304 00000040:00080000:2.0:1705683932.365226:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4865, 64 off348608 00000040:00080000:2.0:1705683932.365233:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].908, 64 off66368 00000040:00080000:2.0:1705683932.365240:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4866, 64 off348672 00000040:00080000:2.0:1705683932.365247:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].909, 64 off66432 00000040:00080000:2.0:1705683932.365254:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4867, 64 off348736 00000040:00080000:2.0:1705683932.365261:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].910, 64 off66496 00000040:00080000:2.0:1705683932.365268:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4868, 64 off348800 00000040:00080000:2.0:1705683932.365275:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].911, 64 off66560 00000040:00080000:2.0:1705683932.365282:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4869, 64 off348864 00000040:00080000:2.0:1705683932.365288:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].912, 64 off66624 00000040:00080000:2.0:1705683932.365293:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4870, 64 off348928 00000040:00080000:2.0:1705683932.365296:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].913, 64 off66688 00000040:00080000:2.0:1705683932.365300:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4871, 64 off348992 00000040:00080000:2.0:1705683932.365304:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].914, 64 off66752 00000040:00080000:2.0:1705683932.365307:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4872, 64 off349056 00000040:00080000:2.0:1705683932.365311:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].915, 64 off66816 00000040:00080000:2.0:1705683932.365315:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4873, 64 off349120 00000040:00080000:2.0:1705683932.365318:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].916, 64 off66880 00000040:00080000:2.0:1705683932.365322:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4874, 64 off349184 00000040:00080000:2.0:1705683932.365325:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].917, 64 off66944 00000040:00080000:2.0:1705683932.365329:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4875, 64 off349248 00000040:00080000:2.0:1705683932.365332:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].918, 64 off67008 00000040:00080000:2.0:1705683932.365335:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4876, 64 off349312 00000040:00080000:2.0:1705683932.365339:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].919, 64 off67072 00000040:00080000:2.0:1705683932.365342:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4877, 64 off349376 00000040:00080000:2.0:1705683932.365346:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].920, 64 off67136 00000040:00080000:2.0:1705683932.365349:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4878, 64 off349440 00000040:00080000:2.0:1705683932.365353:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].921, 64 off67200 00000040:00080000:2.0:1705683932.365356:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4879, 64 off349504 00000040:00080000:2.0:1705683932.365360:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].922, 64 off67264 00000040:00080000:2.0:1705683932.365363:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4880, 64 off349568 00000040:00080000:2.0:1705683932.365366:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].923, 64 off67328 00000040:00080000:2.0:1705683932.365370:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4881, 64 off349632 00000040:00080000:2.0:1705683932.365373:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].924, 64 off67392 00000040:00080000:2.0:1705683932.365377:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4882, 64 off349696 00000040:00080000:2.0:1705683932.365380:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].925, 64 off67456 00000040:00080000:2.0:1705683932.365384:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4883, 64 off349760 00000040:00080000:2.0:1705683932.365388:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].926, 64 off67520 00000040:00080000:2.0:1705683932.365391:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4884, 64 off349824 00000040:00080000:2.0:1705683932.365394:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].927, 64 off67584 00000040:00080000:2.0:1705683932.365398:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4885, 64 off349888 00000040:00080000:2.0:1705683932.365402:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].928, 64 off67648 00000040:00080000:2.0:1705683932.365405:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4886, 64 off349952 00000040:00080000:2.0:1705683932.365409:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].929, 64 off67712 00000040:00080000:2.0:1705683932.365412:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4887, 64 off350016 00000040:00080000:2.0:1705683932.365416:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].930, 64 off67776 00000040:00080000:2.0:1705683932.365419:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4888, 64 off350080 00000040:00080000:2.0:1705683932.365422:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].931, 64 off67840 00000040:00080000:2.0:1705683932.365426:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4889, 64 off350144 00000040:00080000:2.0:1705683932.365429:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].932, 64 off67904 00000040:00080000:2.0:1705683932.365433:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4890, 64 off350208 00000040:00080000:2.0:1705683932.365436:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].933, 64 off67968 00000040:00080000:2.0:1705683932.365439:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4891, 64 off350272 00000040:00080000:2.0:1705683932.365443:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].934, 64 off68032 00000040:00080000:2.0:1705683932.365446:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4892, 64 off350336 00000040:00080000:2.0:1705683932.365449:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].935, 64 off68096 00000040:00080000:2.0:1705683932.365453:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4893, 64 off350400 00000040:00080000:2.0:1705683932.365456:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].936, 64 off68160 00000040:00080000:2.0:1705683932.365460:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4894, 64 off350464 00000040:00080000:2.0:1705683932.365463:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].937, 64 off68224 00000040:00080000:2.0:1705683932.365466:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4895, 64 off350528 00000040:00080000:2.0:1705683932.365470:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].938, 64 off68288 00000040:00080000:2.0:1705683932.365473:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4896, 64 off350592 00000040:00080000:2.0:1705683932.365477:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].939, 64 off68352 00000040:00080000:2.0:1705683932.365480:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4897, 64 off350656 00000040:00080000:2.0:1705683932.365483:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].940, 64 off68416 00000040:00080000:2.0:1705683932.365487:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4898, 64 off350720 00000040:00080000:2.0:1705683932.365490:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].941, 64 off68480 00000040:00080000:2.0:1705683932.365494:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4899, 64 off350784 00000040:00080000:2.0:1705683932.365497:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].942, 64 off68544 00000040:00080000:2.0:1705683932.365501:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4900, 64 off350848 00000040:00080000:2.0:1705683932.365504:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].943, 64 off68608 00000040:00080000:2.0:1705683932.365507:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4901, 64 off350912 00000040:00080000:2.0:1705683932.365511:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].944, 64 off68672 00000040:00080000:2.0:1705683932.365514:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4902, 64 off350976 00000040:00080000:2.0:1705683932.365518:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].945, 64 off68736 00000040:00080000:2.0:1705683932.365521:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4903, 64 off351040 00000040:00080000:2.0:1705683932.365524:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].946, 64 off68800 00000040:00080000:2.0:1705683932.365528:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4904, 64 off351104 00000040:00080000:2.0:1705683932.365531:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].947, 64 off68864 00000040:00080000:2.0:1705683932.365535:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4905, 64 off351168 00000040:00080000:2.0:1705683932.365538:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].948, 64 off68928 00000040:00080000:2.0:1705683932.365541:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4906, 64 off351232 00000040:00080000:2.0:1705683932.365545:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].949, 64 off68992 00000040:00080000:2.0:1705683932.365548:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4907, 64 off351296 00000040:00080000:2.0:1705683932.365552:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].950, 64 off69056 00000040:00080000:2.0:1705683932.365555:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4908, 64 off351360 00000040:00080000:2.0:1705683932.365558:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].951, 64 off69120 00000040:00080000:2.0:1705683932.365562:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4909, 64 off351424 00000040:00080000:2.0:1705683932.365565:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].952, 64 off69184 00000040:00080000:2.0:1705683932.365568:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4910, 64 off351488 00000040:00080000:2.0:1705683932.365572:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].953, 64 off69248 00000040:00080000:2.0:1705683932.365575:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4911, 64 off351552 00000040:00080000:2.0:1705683932.365579:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].954, 64 off69312 00000040:00080000:2.0:1705683932.365582:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4912, 64 off351616 00000040:00080000:2.0:1705683932.365585:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].955, 64 off69376 00000040:00080000:2.0:1705683932.365589:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4913, 64 off351680 00000040:00080000:2.0:1705683932.365592:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].956, 64 off69440 00000040:00080000:2.0:1705683932.365596:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4914, 64 off351744 00000040:00080000:2.0:1705683932.365599:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].957, 64 off69504 00000040:00080000:2.0:1705683932.365603:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4915, 64 off351808 00000040:00080000:2.0:1705683932.365606:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].958, 64 off69568 00000040:00080000:2.0:1705683932.365609:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4916, 64 off351872 00000040:00080000:2.0:1705683932.365613:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].959, 64 off69632 00000040:00080000:2.0:1705683932.365616:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4917, 64 off351936 00000040:00080000:2.0:1705683932.365639:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].960, 64 off69696 00000040:00080000:2.0:1705683932.365646:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4918, 64 off352000 00000040:00080000:2.0:1705683932.365651:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].961, 64 off69760 00000040:00080000:2.0:1705683932.365654:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4919, 64 off352064 00000040:00080000:2.0:1705683932.365658:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].962, 64 off69824 00000040:00080000:2.0:1705683932.365662:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4920, 64 off352128 00000040:00080000:2.0:1705683932.365665:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].963, 64 off69888 00000040:00080000:2.0:1705683932.365669:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4921, 64 off352192 00000040:00080000:2.0:1705683932.365672:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].964, 64 off69952 00000040:00080000:2.0:1705683932.365675:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4922, 64 off352256 00000040:00080000:2.0:1705683932.365679:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].965, 64 off70016 00000040:00080000:2.0:1705683932.365696:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4923, 64 off352320 00000040:00080000:2.0:1705683932.365702:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].966, 64 off70080 00000040:00080000:2.0:1705683932.365706:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4924, 64 off352384 00000040:00080000:2.0:1705683932.365720:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].967, 64 off70144 00000040:00080000:2.0:1705683932.365725:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4925, 64 off352448 00000040:00080000:2.0:1705683932.365728:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].968, 64 off70208 00000040:00080000:2.0:1705683932.365732:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4926, 64 off352512 00000040:00080000:2.0:1705683932.365736:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].969, 64 off70272 00000040:00080000:2.0:1705683932.365739:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4927, 64 off352576 00000040:00080000:2.0:1705683932.365743:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].970, 64 off70336 00000040:00080000:2.0:1705683932.365747:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4928, 64 off352640 00000040:00080000:2.0:1705683932.365750:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].971, 64 off70400 00000040:00080000:2.0:1705683932.365754:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4929, 64 off352704 00000040:00080000:2.0:1705683932.365757:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].972, 64 off70464 00000040:00080000:2.0:1705683932.365761:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4930, 64 off352768 00000040:00080000:2.0:1705683932.365764:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].973, 64 off70528 00000040:00080000:2.0:1705683932.365768:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4931, 64 off352832 00000040:00080000:2.0:1705683932.365771:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].974, 64 off70592 00000040:00080000:2.0:1705683932.365775:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4932, 64 off352896 00000040:00080000:2.0:1705683932.365778:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].975, 64 off70656 00000040:00080000:2.0:1705683932.365782:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4933, 64 off352960 00000040:00080000:2.0:1705683932.365785:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].976, 64 off70720 00000040:00080000:2.0:1705683932.365789:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4934, 64 off353024 00000040:00080000:2.0:1705683932.365792:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].977, 64 off70784 00000040:00080000:2.0:1705683932.365796:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4935, 64 off353088 00000040:00080000:2.0:1705683932.365799:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].978, 64 off70848 00000040:00080000:2.0:1705683932.365802:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4936, 64 off353152 00000040:00080000:2.0:1705683932.365806:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].979, 64 off70912 00000040:00080000:2.0:1705683932.365809:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4937, 64 off353216 00000040:00080000:2.0:1705683932.365813:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].980, 64 off70976 00000040:00080000:2.0:1705683932.365816:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4938, 64 off353280 00000040:00080000:2.0:1705683932.365820:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].981, 64 off71040 00000040:00080000:2.0:1705683932.365823:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4939, 64 off353344 00000040:00080000:2.0:1705683932.365826:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].982, 64 off71104 00000040:00080000:2.0:1705683932.365830:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4940, 64 off353408 00000040:00080000:2.0:1705683932.365833:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].983, 64 off71168 00000040:00080000:2.0:1705683932.365837:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4941, 64 off353472 00000040:00080000:2.0:1705683932.365840:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].984, 64 off71232 00000040:00080000:2.0:1705683932.365844:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4942, 64 off353536 00000040:00080000:2.0:1705683932.365847:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].985, 64 off71296 00000040:00080000:2.0:1705683932.365850:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4943, 64 off353600 00000040:00080000:2.0:1705683932.365854:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].986, 64 off71360 00000040:00080000:2.0:1705683932.365857:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4944, 64 off353664 00000040:00080000:2.0:1705683932.365861:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].987, 64 off71424 00000040:00080000:2.0:1705683932.365865:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4945, 64 off353728 00000040:00080000:2.0:1705683932.365868:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].988, 64 off71488 00000040:00080000:2.0:1705683932.365872:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4946, 64 off353792 00000040:00080000:2.0:1705683932.365875:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].989, 64 off71552 00000040:00080000:2.0:1705683932.365879:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4947, 64 off353856 00000040:00080000:2.0:1705683932.365882:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].990, 64 off71616 00000040:00080000:2.0:1705683932.365886:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4948, 64 off353920 00000040:00080000:2.0:1705683932.365889:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].991, 64 off71680 00000040:00080000:2.0:1705683932.365893:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4949, 64 off353984 00000040:00080000:2.0:1705683932.365896:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].992, 64 off71744 00000040:00080000:2.0:1705683932.365900:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4950, 64 off354048 00000040:00080000:2.0:1705683932.365903:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].993, 64 off71808 00000040:00080000:2.0:1705683932.365907:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4951, 64 off354112 00000040:00080000:2.0:1705683932.365910:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].994, 64 off71872 00000040:00080000:2.0:1705683932.365913:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4952, 64 off354176 00000040:00080000:2.0:1705683932.365917:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].995, 64 off71936 00000040:00080000:2.0:1705683932.365920:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4953, 64 off354240 00000040:00080000:2.0:1705683932.365924:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].996, 64 off72000 00000040:00080000:2.0:1705683932.365927:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4954, 64 off354304 00000040:00080000:2.0:1705683932.365931:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].997, 64 off72064 00000040:00080000:2.0:1705683932.365934:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4955, 64 off354368 00000040:00080000:2.0:1705683932.365938:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].998, 64 off72128 00000040:00080000:2.0:1705683932.365941:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4956, 64 off354432 00000040:00080000:2.0:1705683932.365945:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].999, 64 off72192 00000040:00080000:2.0:1705683932.365948:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4957, 64 off354496 00000040:00080000:2.0:1705683932.365951:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1000, 64 off72256 00000040:00080000:2.0:1705683932.365955:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4958, 64 off354560 00000040:00080000:2.0:1705683932.365959:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1001, 64 off72320 00000040:00080000:2.0:1705683932.365962:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4959, 64 off354624 00000040:00080000:2.0:1705683932.365965:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1002, 64 off72384 00000040:00080000:2.0:1705683932.365969:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4960, 64 off354688 00000040:00080000:2.0:1705683932.365972:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1003, 64 off72448 00000040:00080000:2.0:1705683932.365976:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4961, 64 off354752 00000100:00100000:2.0:1705683932.366002:0:10725:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584481536:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1705683932.366017:0:10725:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.366024:0:10725:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a0c0 going to sleep for 161 seconds 00000100:00100000:2.0:1705683932.366029:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.366029:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.366033:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584481536 00000100:00100000:2.0:1705683932.366041:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.366041:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.366043:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920540 00000100:00100000:2.0:1705683932.366045:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+3109:10725:x1788538584481536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1705683932.366059:0:15095:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0001: reserve 128 objects in group 0x2c0000402 at 39554 00000040:00080000:2.0:1705683932.366161:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1004, 64 off72512 00000040:00080000:2.0:1705683932.366170:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4962, 64 off354816 00000040:00080000:2.0:1705683932.366175:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1005, 64 off72576 00000040:00080000:2.0:1705683932.366179:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4963, 64 off354880 00000040:00080000:2.0:1705683932.366183:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1006, 64 off72640 00000040:00080000:2.0:1705683932.366187:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4964, 64 off354944 00000040:00080000:2.0:1705683932.366190:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1007, 64 off72704 00000040:00080000:2.0:1705683932.366194:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4965, 64 off355008 00000040:00080000:2.0:1705683932.366197:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1008, 64 off72768 00000040:00080000:2.0:1705683932.366201:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4966, 64 off355072 00000040:00080000:2.0:1705683932.366204:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1009, 64 off72832 00000040:00080000:2.0:1705683932.366208:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4967, 64 off355136 00000040:00080000:2.0:1705683932.366211:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1010, 64 off72896 00000040:00080000:2.0:1705683932.366215:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4968, 64 off355200 00000040:00080000:2.0:1705683932.366218:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1011, 64 off72960 00000040:00080000:2.0:1705683932.366222:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4969, 64 off355264 00000040:00080000:2.0:1705683932.366225:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1012, 64 off73024 00000040:00080000:2.0:1705683932.366229:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4970, 64 off355328 00000040:00080000:2.0:1705683932.366233:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1013, 64 off73088 00000040:00080000:2.0:1705683932.366236:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4971, 64 off355392 00000040:00080000:2.0:1705683932.366240:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1014, 64 off73152 00000040:00080000:2.0:1705683932.366243:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4972, 64 off355456 00000040:00080000:2.0:1705683932.366247:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1015, 64 off73216 00000040:00080000:2.0:1705683932.366250:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4973, 64 off355520 00000040:00080000:2.0:1705683932.366254:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1016, 64 off73280 00000040:00080000:2.0:1705683932.366258:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4974, 64 off355584 00000040:00080000:2.0:1705683932.366261:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1017, 64 off73344 00000040:00080000:2.0:1705683932.366265:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4975, 64 off355648 00000040:00080000:2.0:1705683932.366268:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1018, 64 off73408 00000040:00080000:2.0:1705683932.366272:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4976, 64 off355712 00000040:00080000:2.0:1705683932.366275:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1019, 64 off73472 00000040:00080000:2.0:1705683932.366279:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4977, 64 off355776 00000040:00080000:2.0:1705683932.366282:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1020, 64 off73536 00000040:00080000:2.0:1705683932.366286:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4978, 64 off355840 00000040:00080000:2.0:1705683932.366289:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1021, 64 off73600 00000040:00080000:2.0:1705683932.366293:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4979, 64 off355904 00000040:00080000:2.0:1705683932.366296:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1022, 64 off73664 00000040:00080000:2.0:1705683932.366300:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4980, 64 off355968 00000040:00080000:2.0:1705683932.366303:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1023, 64 off73728 00000040:00080000:2.0:1705683932.366307:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4981, 64 off356032 00000040:00080000:2.0:1705683932.366331:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1024, 64 off73792 00000040:00080000:2.0:1705683932.366338:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4982, 64 off356096 00000040:00080000:2.0:1705683932.366342:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1025, 64 off73856 00000040:00080000:2.0:1705683932.366345:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4983, 64 off356160 00000040:00080000:2.0:1705683932.366349:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1026, 64 off73920 00000040:00080000:2.0:1705683932.366353:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4984, 64 off356224 00000040:00080000:2.0:1705683932.366357:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1027, 64 off73984 00000040:00080000:2.0:1705683932.366360:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4985, 64 off356288 00000040:00080000:2.0:1705683932.366364:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1028, 64 off74048 00000040:00080000:2.0:1705683932.366367:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4986, 64 off356352 00000040:00080000:2.0:1705683932.366371:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1029, 64 off74112 00000040:00080000:2.0:1705683932.366389:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4987, 64 off356416 00000040:00080000:2.0:1705683932.366395:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1030, 64 off74176 00000040:00080000:2.0:1705683932.366399:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4988, 64 off356480 00000040:00080000:2.0:1705683932.366402:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1031, 64 off74240 00000040:00080000:2.0:1705683932.366406:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4989, 64 off356544 00000040:00080000:2.0:1705683932.366410:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1032, 64 off74304 00000040:00080000:2.0:1705683932.366414:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4990, 64 off356608 00000040:00080000:2.0:1705683932.366417:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1033, 64 off74368 00000040:00080000:2.0:1705683932.366421:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4991, 64 off356672 00000040:00080000:2.0:1705683932.366425:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1034, 64 off74432 00000040:00080000:2.0:1705683932.366428:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4992, 64 off356736 00000040:00080000:2.0:1705683932.366432:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1035, 64 off74496 00000040:00080000:2.0:1705683932.366436:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4993, 64 off356800 00000040:00080000:2.0:1705683932.366439:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1036, 64 off74560 00000040:00080000:2.0:1705683932.366442:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4994, 64 off356864 00000040:00080000:2.0:1705683932.366446:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1037, 64 off74624 00000040:00080000:2.0:1705683932.366449:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4995, 64 off356928 00000040:00080000:2.0:1705683932.366453:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1038, 64 off74688 00000040:00080000:2.0:1705683932.366457:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4996, 64 off356992 00000040:00080000:2.0:1705683932.366460:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1039, 64 off74752 00000040:00080000:2.0:1705683932.366464:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4997, 64 off357056 00000040:00080000:2.0:1705683932.366467:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1040, 64 off74816 00000040:00080000:2.0:1705683932.366471:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4998, 64 off357120 00000040:00080000:2.0:1705683932.366474:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1041, 64 off74880 00010000:00010000:2.0:1705683932.366481:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.366483:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d561e00/0xefc4487a01877f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366487:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d561e00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.366488:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d561e00/0xefc4487a01877f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366491:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d561e00/0xefc4487a01877f87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x868f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366497:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d561e00/0xefc4487a01877f87 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x868f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366499:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d561e00/0xefc4487a01877f87 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x868f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366514:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.366516:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124051b80/0xefc4487a01877eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366519:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124051b80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.366520:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124051b80/0xefc4487a01877eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366524:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124051b80/0xefc4487a01877eca lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366530:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124051b80/0xefc4487a01877eca lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366535:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124051b80/0xefc4487a01877eca lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.366546:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.366546:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.366547:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367169:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.367172:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124053200/0xefc4487a01877f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367178:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124053200 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.367179:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124053200/0xefc4487a01877f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367182:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124053200/0xefc4487a01877f6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x868d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367187:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124053200/0xefc4487a01877f6b lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x868d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367190:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124053200/0xefc4487a01877f6b lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x868d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367197:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.367198:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367200:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013232a080 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.367201:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367203:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367208:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367212:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013232a080/0xefc4487a01877f64 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x868c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15218 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367218:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367218:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367219:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.367533:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4999, 64 off357184 00000040:00080000:2.0:1705683932.367542:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1042, 64 off74944 00000040:00080000:2.0:1705683932.367546:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5000, 64 off357248 00000040:00080000:2.0:1705683932.367550:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1043, 64 off75008 00000040:00080000:2.0:1705683932.367554:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5001, 64 off357312 00000040:00080000:2.0:1705683932.367558:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1044, 64 off75072 00000040:00080000:2.0:1705683932.367562:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5002, 64 off357376 00000040:00080000:2.0:1705683932.367566:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1045, 64 off75136 00000040:00080000:2.0:1705683932.367569:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5003, 64 off357440 00000040:00080000:2.0:1705683932.367573:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1046, 64 off75200 00000040:00080000:2.0:1705683932.367577:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5004, 64 off357504 00000040:00080000:2.0:1705683932.367580:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1047, 64 off75264 00000040:00080000:2.0:1705683932.367584:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5005, 64 off357568 00000040:00080000:2.0:1705683932.367588:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1048, 64 off75328 00000040:00080000:2.0:1705683932.367591:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5006, 64 off357632 00000040:00080000:2.0:1705683932.367595:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1049, 64 off75392 00000040:00080000:2.0:1705683932.367598:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5007, 64 off357696 00010000:00010000:2.0:1705683932.367631:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:2.0:1705683932.367635:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367638:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367642:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367644:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367645:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367651:0:8825:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.367658:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367660:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367662:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367664:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880132328780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.367665:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367667:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367670:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x406f:0x0].0x0 (ffff880099994400) 00010000:00010000:2.0:1705683932.367671:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1705683932.367672:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367674:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132328780/0xefc4487a01877e4c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x406f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367685:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.367687:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367689:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880132328000 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.367690:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367691:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367693:0:8828:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x406f:0x0].0x0 (ffff880099994400) 00010000:00010000:2.0:1705683932.367694:0:8828:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1705683932.367695:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367696:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01877fd4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x406f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.367699:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.367700:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b8a3c00/0xefc4487a01877f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367703:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009b8a3c00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.367703:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b8a3c00/0xefc4487a01877f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367705:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b8a3c00/0xefc4487a01877f79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x868b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367722:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b8a3c00/0xefc4487a01877f79 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x868b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367725:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8a3c00/0xefc4487a01877f79 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x868b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.367733:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367733:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367734:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.367736:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.367738:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.367738:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.367826:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131dc0500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3119:3083:x1788538584480192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4391us (4450us total) trans 4295348116 rc 0/0 00000100:00100000:2.0:1705683932.367829:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920533 00000004:00080000:2.0:1705683932.367843:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc1400/2, rc 0, transno 380820 00000100:00100000:2.0:1705683932.367853:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc1400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584480192:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.367911:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.367913:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.368097:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.368098:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.368102:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641001920 00000100:00100000:2.0:1705683932.368114:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.368115:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.368118:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59873 00000100:00100000:2.0:1705683932.368120:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1773:1857:x1788538641001920:12345-192.168.203.41@tcp:63:ll_sa.0 00010000:00010000:2.0:1705683932.368177:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.368182:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013232af80/0xefc4487a01877ff7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e07 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368228:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368233:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368236:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368300:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368303:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368305:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368330:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368333:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368335:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.368347:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41ce:0x0]: returning size 0 00000004:00200000:2.0:1705683932.368349:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.368354:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368358:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368360:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368363:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368364:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368366:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013232b700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368367:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368369:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368372:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.368373:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368374:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368375:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013232b700/0xefc4487a01877ffe lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368379:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368381:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368383:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368385:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013588d900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368386:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368388:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368390:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x39 (ffff8800735b6900) 00010000:00010000:2.0:1705683932.368391:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368391:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368393:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a01878005 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368409:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013232af80/0xefc4487a01877ff7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e07 expref: 1775 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368413:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588e080/0xefc4487a0187801a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e07 expref: 1774 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368416:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ce:0x0].0x0 (ffff88009e2d2100) 00010000:00010000:2.0:1705683932.368416:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.368417:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013588e080, rc 0) 00010000:00010000:2.0:1705683932.368419:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.368421:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a01878021 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e0e expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368429:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368431:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368436:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368460:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368462:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368464:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368483:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368486:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368488:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.368498:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x42b4:0x0]: returning size 0 00000004:00200000:2.0:1705683932.368499:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.368502:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368504:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368507:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368508:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368512:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368514:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131eb8780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368515:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368517:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368519:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.368520:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368521:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368523:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878028 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368526:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368529:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368530:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368532:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131eba080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368533:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368534:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368537:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3931 (ffff8800735b6100) 00010000:00010000:2.0:1705683932.368538:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368538:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368540:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131eba080/0xefc4487a0187802f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368553:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a01878021 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e0e expref: 1777 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368558:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebb480/0xefc4487a01878036 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e0e expref: 1777 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368560:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b4:0x0].0x0 (ffff880131741000) 00010000:00010000:2.0:1705683932.368561:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.368562:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131ebb480, rc 0) 00010000:00010000:2.0:1705683932.368563:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.368566:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb9680/0xefc4487a0187803d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e15 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368572:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368575:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368577:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368601:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368603:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368606:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368619:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368622:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368624:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.368633:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x434d:0x0]: returning size 14811136 00000004:00200000:2.0:1705683932.368635:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.368637:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368640:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368642:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368644:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368646:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368647:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131ebad00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368648:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368650:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368653:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.368654:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368655:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368656:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131ebad00/0xefc4487a01878044 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368660:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368662:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368664:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368665:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131eb8a00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368666:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368668:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368670:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3031 (ffff8800735b6600) 00010000:00010000:2.0:1705683932.368670:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368671:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368673:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8a00/0xefc4487a0187804b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368686:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb9680/0xefc4487a0187803d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e15 expref: 1778 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368690:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e15 expref: 1777 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368693:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x434d:0x0].0x0 (ffff8800a0400400) 00010000:00010000:2.0:1705683932.368694:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.368694:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7d680, rc 0) 00010000:00010000:2.0:1705683932.368696:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.368699:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f480/0xefc4487a01878060 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e1c expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368705:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368719:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368722:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368747:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368749:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368752:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368768:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368771:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368773:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.368783:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41bf:0x0]: returning size 0 00000004:00200000:2.0:1705683932.368784:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.368787:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368789:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368791:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368793:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368795:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368796:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7ca00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368797:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368799:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368802:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.368803:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368803:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368805:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ca00/0xefc4487a01878067 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368811:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368813:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368815:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368817:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7e300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368817:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368819:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368821:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3431 (ffff88009afd8100) 00010000:00010000:2.0:1705683932.368822:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368822:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368824:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e300/0xefc4487a0187806e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368839:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f480/0xefc4487a01878060 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e1c expref: 1779 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368846:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e1c expref: 1778 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368849:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41bf:0x0].0x0 (ffff88008747e800) 00010000:00010000:2.0:1705683932.368850:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.368851:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7db80, rc 0) 00010000:00010000:2.0:1705683932.368852:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.368855:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7c280/0xefc4487a0187807c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e23 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.368861:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368864:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368867:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368910:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368913:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368915:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368929:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.368932:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368934:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.368944:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x437e:0x0]: returning size 0 00000004:00200000:2.0:1705683932.368945:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.368948:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368950:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368953:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368954:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368956:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368958:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7d400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368959:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368960:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368963:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.368964:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368965:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368967:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d400/0xefc4487a01878083 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368971:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368974:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368975:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368977:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7fc00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.368978:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368979:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368981:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x37 (ffff88009afd8600) 00010000:00010000:2.0:1705683932.368982:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.368982:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368984:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7fc00/0xefc4487a01878091 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.368999:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7c280/0xefc4487a0187807c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e23 expref: 1780 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369003:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e23 expref: 1779 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369005:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x437e:0x0].0x0 (ffff8801330f0c00) 00010000:00010000:2.0:1705683932.369006:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.369007:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7ef80, rc 0) 00010000:00010000:2.0:1705683932.369009:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.369011:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d900/0xefc4487a018780ad lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e2a expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369019:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369021:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369024:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369076:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369093:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369096:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369110:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369113:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369115:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.369125:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4180:0x0]: returning size 0 00000004:00200000:2.0:1705683932.369126:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.369129:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369132:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369134:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369136:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369138:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369140:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7f700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369141:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369142:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369145:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.369146:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369146:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369148:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f700/0xefc4487a018780b4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369152:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369154:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369158:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369160:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7ea80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369161:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369162:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369164:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x38 (ffff88009afd8900) 00010000:00010000:2.0:1705683932.369165:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369165:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369167:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ea80/0xefc4487a018780c2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369185:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d900/0xefc4487a018780ad lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e2a expref: 1781 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369192:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7f980/0xefc4487a018780d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4180:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e2a expref: 1780 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369196:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4180:0x0].0x0 (ffff880098910500) 00010000:00010000:2.0:1705683932.369197:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.369198:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7f980, rc 0) 00010000:00010000:2.0:1705683932.369200:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.369204:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7c000/0xefc4487a018780d7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e31 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369219:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369224:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369228:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369260:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369263:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369266:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369282:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369284:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369286:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.369297:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x420d:0x0]: returning size 0 00000004:00200000:2.0:1705683932.369298:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.369301:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369303:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369306:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369308:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369310:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369311:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7e800 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369312:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369314:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369317:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.369317:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369318:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369320:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7e800/0xefc4487a018780de lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369325:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369327:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369329:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369331:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369332:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369334:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369336:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3831 (ffff88009afd8400) 00010000:00010000:2.0:1705683932.369337:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369337:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369339:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018780e5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369354:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7c000/0xefc4487a018780d7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e31 expref: 1782 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369359:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caf80/0xefc4487a018780ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x420d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e31 expref: 1781 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369361:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x420d:0x0].0x0 (ffff8800a6c8dd00) 00010000:00010000:2.0:1705683932.369362:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.369363:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998caf80, rc 0) 00010000:00010000:2.0:1705683932.369364:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.369368:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9900/0xefc4487a018780f3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e38 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369379:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369383:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369390:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369420:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369423:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369426:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369441:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.369444:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369446:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00000004:00200000:2.0:1705683932.369455:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41b6:0x0]: returning size 0 00000004:00200000:2.0:1705683932.369456:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.369459:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369462:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369464:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369466:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369470:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369472:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cb980 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369472:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369474:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369477:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:2.0:1705683932.369478:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369478:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369480:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a01878101 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369485:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369487:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369489:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369491:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c8000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.369491:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369493:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369497:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x31 (ffff88009afd8500) 00010000:00010000:2.0:1705683932.369498:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.369498:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369500:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a01878108 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT1 00010000:00010000:2.0:1705683932.369515:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9900/0xefc4487a018780f3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e38 expref: 1783 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369520:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cbc00/0xefc4487a0187810f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e38 expref: 1782 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369522:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41b6:0x0].0x0 (ffff8801240a4000) 00010000:00010000:2.0:1705683932.369523:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.369524:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998cbc00, rc 0) 00000100:00100000:2.0:1705683932.369538:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1782:1857:x1788538641001920:12345-192.168.203.41@tcp:63:ll_sa.0 Request processed in 1417us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.369542:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59873 00010000:00010000:2.0:1705683932.369681:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.369683:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124052800/0xefc4487a01877f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369687:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124052800 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.369688:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124052800/0xefc4487a01877f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x868a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369693:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124052800/0xefc4487a01877f56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x868a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369698:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124052800/0xefc4487a01877f56 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x868a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369700:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124052800/0xefc4487a01877f56 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x868a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369721:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.369722:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124053480/0xefc4487a01877f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369725:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124053480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.369726:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124053480/0xefc4487a01877f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369729:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124053480/0xefc4487a01877f80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369733:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124053480/0xefc4487a01877f80 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369736:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124053480/0xefc4487a01877f80 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.369745:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.369745:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.369746:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.369858:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.369859:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.370838:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.370841:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124050000/0xefc4487a01877fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.370844:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880124050000 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.370845:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124050000/0xefc4487a01877fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.370848:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124050000/0xefc4487a01877fdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.370853:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124050000/0xefc4487a01877fdb lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.370856:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124050000/0xefc4487a01877fdb lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.370863:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.370863:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.370864:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.372199:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372205:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372208:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372210:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372211:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880132328280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.372212:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372214:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372218:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:2.0:1705683932.372219:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372220:0:8825:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.372223:0:8825:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.372225:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.372230:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.372237:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372239:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132328280/0xefc4487a01877e3e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8825 initiator: MDT1 00000004:00010000:2.0:1705683932.372247:0:8825:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880133630000 reply state ffff880094e95000 transno 4295084926 ns: mdt-lustre-MDT0001_UUID lock: ffff88013232bc00/0xefc4487a01877e45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372250:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013232bc00/0xefc4487a01877e45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3fe1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:2.0:1705683932.372253:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x3631 (ffff8800735b6f00) 00010000:00010000:2.0:1705683932.372253:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372266:0:14205:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.372268:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00000004:00200000:2.0:1705683932.372279:0:14205:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x3fe1:0x0]: returning size 4096 00000004:00200000:2.0:1705683932.372280:0:14205:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.372284:0:14205:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:2.0:1705683932.372300:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47200/0xefc4487a01878132 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300df9 expref: 1788 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372305:0:14205:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300df9 expref: 1787 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372308:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:2.0:1705683932.372309:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1705683932.372309:0:14205:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d47980, rc 0) 00000100:00100000:2.0:1705683932.372318:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e85c100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7319:x1788538641001728:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 2436us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.372323:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413355 00000100:00100000:2.0:1705683932.372329:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372330:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372333:0:14205:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641004032 00000100:00100000:2.0:1705683932.372341:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372341:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372343:0:14205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413358 00000100:00100000:2.0:1705683932.372345:0:14205:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013713cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1911:7185:x1788538641004032:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1705683932.372350:0:14205:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.372357:0:14205:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a01878186 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e62 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1705683932.372392:0:14205:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000402:0x438c:0x0]: returning size 4096 00010000:00010000:2.0:1705683932.372422:0:14205:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a01878186 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e62 expref: 1913 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372426:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a01878186 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e62 expref: 1913 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372431:0:14205:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998cb700, rc 0) 00000100:00100000:2.0:1705683932.372442:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013713cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1912:7185:x1788538641004032:12345-192.168.203.41@tcp:101:rm.0 Request processed in 96us (205us total) trans 4295091431 rc 301/301 00000100:00100000:2.0:1705683932.372444:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413358 00000100:00100000:2.0:1705683932.372454:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372455:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372457:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641004160 00000100:00100000:2.0:1705683932.372464:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372465:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.372467:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59874 00000100:00100000:2.0:1705683932.372469:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013713bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1912:1855:x1788538641004160:12345-192.168.203.41@tcp:63:ll_sa.0 00010000:00010000:2.0:1705683932.372477:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.372481:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb200/0xefc4487a0187819b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e70 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372523:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372527:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372530:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372584:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372586:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372589:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372613:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372616:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372618:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00000004:00200000:2.0:1705683932.372629:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000404:0x40d8:0x0]: returning size 0 00000004:00200000:2.0:1705683932.372630:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.372635:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372638:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372640:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372642:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372644:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372646:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c8500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.372646:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372648:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372651:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:2.0:1705683932.372652:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372653:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372655:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8500/0xefc4487a018781a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372660:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372662:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372666:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372668:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c9680 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.372668:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372670:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372672:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x31 (ffff88009afd8c00) 00010000:00010000:2.0:1705683932.372673:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372673:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372675:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9680/0xefc4487a018781a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372690:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb200/0xefc4487a0187819b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e70 expref: 1914 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372695:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e70 expref: 1913 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372697:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40d8:0x0].0x0 (ffff88012cc78a00) 00010000:00010000:2.0:1705683932.372698:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.372698:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c9b80, rc 0) 00010000:00010000:2.0:1705683932.372700:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.372704:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a018781b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e77 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372726:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372728:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372731:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372788:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372792:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372796:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372821:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372826:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372831:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00000004:00200000:2.0:1705683932.372845:0:14256:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000402:0x4355:0x0]: returning size 0 00000004:00200000:2.0:1705683932.372847:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.372852:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372857:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372860:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372864:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372867:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372870:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c9400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.372871:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372874:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372877:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:2.0:1705683932.372878:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372878:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372880:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a018781be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372885:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372887:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372889:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372891:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cad00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.372892:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372894:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372896:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x36 (ffff88009afd8d00) 00010000:00010000:2.0:1705683932.372897:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.372897:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372899:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a018781cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372915:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a018781b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e77 expref: 1915 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372919:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c8280/0xefc4487a018781da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4355:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e77 expref: 1914 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372922:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4355:0x0].0x0 (ffff8800a1096200) 00010000:00010000:2.0:1705683932.372922:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.372923:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c8280, rc 0) 00010000:00010000:2.0:1705683932.372924:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.372928:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9e00/0xefc4487a018781e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300e7e expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.372936:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372939:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372944:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372970:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372973:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372975:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372993:0:14256:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372996:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.372998:0:14256:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00000004:00200000:2.0:1705683932.373009:0:14256:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.373012:0:14256:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373015:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373017:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373019:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373023:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.373024:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373026:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373028:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:2.0:1705683932.373029:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.373030:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373031:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a018781e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373036:0:14256:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373038:0:14256:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373040:0:14256:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373042:0:14256:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c34a00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.373042:0:14256:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373044:0:14256:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373046:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x3731 (ffff88009afd8000) 00010000:00010000:2.0:1705683932.373047:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.373048:0:14256:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 2/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373050:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c34a00/0xefc4487a018781ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14256 initiator: MDT0 00010000:00010000:2.0:1705683932.373065:0:14256:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9e00/0xefc4487a018781e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e7e expref: 1916 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.373070:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e7e expref: 1915 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.373072:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4123:0x0].0x0 (ffff8800a114ae00) 00010000:00010000:2.0:1705683932.373073:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.373074:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0c36f80, rc 0) 00000100:00100000:2.0:1705683932.373101:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013713bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1915:1855:x1788538641004160:12345-192.168.203.41@tcp:63:ll_sa.0 Request processed in 631us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.373105:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59874 00000100:00100000:2.0:1705683932.373165:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7304:x1788538640995776:12345-192.168.203.41@tcp:36:rm.0 Request processed in 15180us (15254us total) trans 4295084926 rc 0/0 00000100:00100000:2.0:1705683932.373168:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413342 00000100:00100000:2.0:1705683932.373216:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3137:3083:x1788538584482432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5472us (5600us total) trans 4295348123 rc 0/0 00000100:00100000:2.0:1705683932.373219:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920548 00000100:00100000:2.0:1705683932.373249:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3136:3084:x1788538584483072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4670us (4779us total) trans 4295348124 rc 0/0 00000100:00100000:2.0:1705683932.373252:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920554 00000100:00100000:2.0:1705683932.373256:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.373257:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.373260:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584485312 00000100:00100000:2.0:1705683932.373265:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.373266:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.373268:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920577 00000100:00100000:2.0:1705683932.373269:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090135f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3136:3082:x1788538584485312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.373275:0:15110:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34461 count 1 00010000:00010000:2.0:1705683932.373339:0:15110:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.373345:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013508af80/0xefc4487a0180671c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d16e2 expref: 4056 pid: 15174 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.373348:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351ccf00/0xefc4487a01859b5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8890 expref: 6012 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.373351:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.373351:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.373352:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.373361:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351ccf00/0xefc4487a01859b5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8890 expref: 6012 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.373365:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351ccf00/0xefc4487a01859b5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8890 expref: 6012 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.373369:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584485504:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.373380:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013508af80/0xefc4487a0180671c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d16e2 expref: 4056 pid: 15174 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.373384:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013508af80/0xefc4487a0180671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d16e2 expref: 4056 pid: 15174 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.373387:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665b200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584485568:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.373391:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a000 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.373423:0:15191:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880124095000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:lustre-MDT0001-mdtlov_UUID+3139:3083:x1788538584481920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6644us (6674us total) trans 4295348125 rc 0/0 00000100:00100000:2.0:1705683932.373426:0:15191:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920544 00000004:00080000:2.0:1705683932.373439:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124095f00/2, rc 0, transno 380829 00000100:00100000:2.0:1705683932.373442:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880124095f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584481920:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373457:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1705683932.373460:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665b700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584485696:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373469:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.373478:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800973c3700/2, rc 0, transno 380841 00000100:00100000:2.0:1705683932.373480:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800973c3700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584485632:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373491:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1705683932.373493:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665ee00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584485824:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373501:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.373510:0:15191:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.373511:0:15191:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.373615:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a665ee00/2, rc 0, transno 380842 00000100:00100000:2.0:1705683932.373619:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665ee00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584485824:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373632:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6659900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584486080:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.373643:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.374185:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+3142:10725:x1788538584481536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 8139us (8167us total) trans 4295348139 rc 0/0 00000100:00100000:2.0:1705683932.374188:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920540 00000100:00100000:2.0:1705683932.374286:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584481536:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1705683932.374291:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x99f0:0x0]-[0x2c0000402:0x9b01:0x0] 00000004:00080000:2.0:1705683932.374399:0:14377:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f1:0x0], index 1: 0 00010000:00010000:2.0:1705683932.374515:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35e00/0xefc4487a01878251 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.374519:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35e00/0xefc4487a01878251 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x438c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374523:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35e00/0xefc4487a01878251 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x438c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374535:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374537:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374539:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374541:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374543:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88012dfa9b80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.374544:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374546:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374549:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1a4:0x0].0x0 (ffff8800875ff800) 00010000:00010000:2.0:1705683932.374550:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.374551:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374553:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfa9b80/0xefc4487a01877ef4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00000004:00010000:2.0:1705683932.374557:0:14377:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880081878000 reply state ffff880094650000 transno 4295084932 ns: mdt-lustre-MDT0001_UUID lock: ffff88009b133480/0xefc4487a0187800c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374560:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009b133480/0xefc4487a0187800c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x1a4:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374562:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x1a4:0x0].0x36 (ffff880136254900) 00010000:00010000:2.0:1705683932.374563:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.374582:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012dfaa800/0xefc4487a01877eed lrc: 0/0,0 mode: --/CW res: [0x240000400:0x1a4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d90 expref: 1786 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.374589:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35e00/0xefc4487a01878251 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x438c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d90 expref: 1785 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.374591:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438c:0x0].0x0 (ffff88009afd8a00) 00010000:00010000:2.0:1705683932.374592:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.374593:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0c35e00, rc 0) 00000100:00100000:2.0:1705683932.374605:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880081878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1786:7316:x1788538640998464:12345-192.168.203.41@tcp:101:touch.0 Request processed in 12871us (12948us total) trans 4295084932 rc 0/0 00000100:00100000:2.0:1705683932.374608:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413346 00000100:00100000:2.0:1705683932.374742:0:10725:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584486336:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1705683932.374755:0:10725:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.374766:0:10725:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a600 going to sleep for 161 seconds 00000100:00100000:2.0:1705683932.374771:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.374772:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.374775:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641004544 00000100:00100000:2.0:1705683932.374783:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.374783:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.374785:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413359 00000100:00100000:2.0:1705683932.374788:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1786:7281:x1788538641004544:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:2.0:1705683932.374793:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.374829:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a01878266 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ea8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.374875:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.374879:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374882:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374926:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.374929:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374931:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374949:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.374953:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374956:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.374967:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x42cb:0x0]: returning size 4096 00000004:00200000:2.0:1705683932.374968:0:14377:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.374972:0:14377:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374975:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374977:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374979:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374981:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374982:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c35180 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.374983:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374985:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374988:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.374989:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.374990:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374992:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187826d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374996:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.374998:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375000:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375002:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c36a80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.375003:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375004:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375006:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88008b2d5e00) 00010000:00010000:2.0:1705683932.375007:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.375008:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375009:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878274 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.375025:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a01878266 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ea8 expref: 1788 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.375029:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ea8 expref: 1787 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.375034:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42cb:0x0].0x0 (ffff8800a1267300) 00010000:00010000:2.0:1705683932.375035:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1705683932.375036:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0c34f00, rc 0) 00000100:00100000:2.0:1705683932.375046:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7281:x1788538641004544:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 257us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.375049:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413359 00000100:00100000:2.0:1705683932.376908:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073781400 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584486272:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1705683932.376915:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8bc1:0x0] 00000100:00100000:2.0:1705683932.377017:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665d000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584486400:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1705683932.377031:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.377038:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a480 going to sleep for 161 seconds 00000100:00100000:2.0:1705683932.377048:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584485504:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.377053:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665b200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584485568:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.377063:0:15110:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.377082:0:15110:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.377083:0:15110:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.377083:0:15110:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377089:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377090:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377094:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584486400 00000100:00100000:2.0:1705683932.377107:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377108:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377110:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920591 00000100:00100000:2.0:1705683932.377113:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+1039:9011:x1788538584486400:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1705683932.377128:0:15215:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 35778 00000100:00100000:2.0:1705683932.377206:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377207:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377210:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641005120 00000100:00100000:2.0:1705683932.377221:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377222:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377223:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641006080 00000100:00100000:2.0:1705683932.377228:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377228:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377231:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413360 00000100:00100000:2.0:1705683932.377233:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbcb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1915:7319:x1788538641005120:12345-192.168.203.41@tcp:36:lfs.0 00000100:00100000:2.0:1705683932.377271:0:14377:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665b200 pname:cluuid:pid:xid:nid:opc:job mdt00_023:lustre-MDT0000-mdtlov_UUID:14377:1788538584486464:0@lo:1000:mdt00_023.0 00000100:00100000:2.0:1705683932.377285:0:14377:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.377292:0:14377:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33af00 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.377298:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377299:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377305:0:14202:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413361 00000100:00100000:2.0:1705683932.377308:0:14202:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbe400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7316:x1788538641006080:12345-192.168.203.41@tcp:36:touch.0 00010000:00010000:2.0:1705683932.377324:0:14202:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.377335:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35e00/0xefc4487a01878251 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x438c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d90 expref: 1788 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.377344:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438c:0x0].0x0 (ffff88009afd8a00) 00010000:00010000:2.0:1705683932.377349:0:14202:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1705683932.377429:0:14202:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37200/0xefc4487a01878289 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.377434:0:14202:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37200/0xefc4487a01878289 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.377439:0:14202:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37200/0xefc4487a01878289 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14202 initiator: MDT1 00000004:00010000:2.0:1705683932.377469:0:14202:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88009ebbe400 reply state ffff8800901f4000 transno 4295084936 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37200/0xefc4487a01878289 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.377472:0:14202:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37200/0xefc4487a01878289 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.377475:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438c:0x0].0x0 (ffff88008b2d5f00) 00010000:00010000:2.0:1705683932.377476:0:14202:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1705683932.377497:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbe400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1789:7316:x1788538641006080:12345-192.168.203.41@tcp:36:touch.0 Request processed in 188us (282us total) trans 4295084936 rc 0/0 00000100:00100000:2.0:1705683932.377500:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413361 00000100:00100000:2.0:1705683932.377512:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377512:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377515:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584486464 00000100:00100000:2.0:1705683932.377526:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377526:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377528:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59875 00000100:00100000:2.0:1705683932.377530:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14377:x1788538584486464:12345-0@lo:1000:mdt00_023.0 00000100:00100000:2.0:1705683932.377569:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14377:x1788538584486464:12345-0@lo:1000:mdt00_023.0 Request processed in 39us (283us total) trans 0 rc 1/1 00000100:00100000:2.0:1705683932.377572:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59875 00000100:00100000:2.0:1705683932.377580:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377580:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.377584:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920595 00000100:00100000:2.0:1705683932.377586:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3530:6496:x1788538641006336:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.377589:0:15131:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.377778:0:15131:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800998c9900/0xefc4487a0187829e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ec4 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.377787:0:15131:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.377792:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.377793:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.377795:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800998c9900/0xefc4487a0187829e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ec4 expref: 3531 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.377800:0:15131:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800998c9900/0xefc4487a0187829e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ec4 expref: 3531 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.377804:0:15131:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c9900, rc 0) 00000100:00100000:2.0:1705683932.377813:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3531:6496:x1788538641006336:12345-192.168.203.41@tcp:101:dd.0 Request processed in 226us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.377816:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920595 00000100:00100000:2.0:1705683932.377833:0:14377:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665b200 pname:cluuid:pid:xid:nid:opc:job mdt00_023:lustre-MDT0000-mdtlov_UUID:14377:1788538584486464:0@lo:1000:mdt00_023.0 00000100:00100000:2.0:1705683932.377851:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbcb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1915:7319:x1788538641005120:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 617us (654us total) trans 0 rc -17/-17 00000100:00100000:2.0:1705683932.377853:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413360 00000100:00100000:2.0:1705683932.378402:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378403:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378407:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641007040 00000100:00100000:2.0:1705683932.378419:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378420:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378423:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413362 00000100:00100000:2.0:1705683932.378426:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880124096900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1868:7307:x1788538641007040:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.378432:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.378491:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a018782a5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ee0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.378559:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.378564:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378567:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378623:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.378625:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378628:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.378644:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x419f:0x0]: returning size 4096 00010000:00010000:2.0:1705683932.378649:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378651:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378653:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378655:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378657:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cb980 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.378659:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378661:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378664:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.378665:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.378666:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378668:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018782ac lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378674:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378676:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378678:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378679:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.378680:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378682:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378684:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff88008b2d5d00) 00010000:00010000:2.0:1705683932.378685:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.378685:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378689:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a018782b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.378706:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a018782a5 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ee0 expref: 1869 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.378725:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8000/0xefc4487a018782a5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ee0 expref: 1869 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.378731:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c8000, rc 0) 00000100:00100000:2.0:1705683932.378743:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880124096900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1868:7307:x1788538641007040:12345-192.168.203.41@tcp:101:dd.0 Request processed in 317us (353us total) trans 0 rc 301/301 00000100:00100000:2.0:1705683932.378746:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413362 00000100:00100000:2.0:1705683932.378786:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665b200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584486720:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.378817:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.378829:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d8d3c00/2, rc 0, transno 380847 00000100:00100000:2.0:1705683932.378833:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584484032:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.378836:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1705683932.378838:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6659e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584486784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.378847:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.378865:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.378868:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584486912:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.378875:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.378881:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378881:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378884:0:15131:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584486912 00000100:00100000:2.0:1705683932.378891:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378892:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378893:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920598 00000100:00100000:2.0:1705683932.378895:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3147:3081:x1788538584486784:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.378901:0:15191:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378901:0:15191:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.378904:0:15191:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920599 00000100:00100000:2.0:1705683932.378906:0:15191:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6658a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:lustre-MDT0001-mdtlov_UUID+3148:3083:x1788538584486912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.378912:0:15191:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34466 count 1 00010000:00010000:2.0:1705683932.379045:0:15191:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379051:0:15191:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315cb200/0xefc4487a018067f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d177c expref: 4050 pid: 15134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379056:0:15191:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bfa4280/0xefc4487a01859c33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88d6 expref: 6005 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379058:0:15191:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379059:0:15191:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379060:0:15191:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379068:0:15191:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bfa4280/0xefc4487a01859c33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88d6 expref: 6004 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379072:0:15191:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bfa4280/0xefc4487a01859c33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88d6 expref: 6004 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379094:0:15191:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0001_UUID:15191:1788538584487040:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.379106:0:15191:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801315cb200/0xefc4487a018067f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d177c expref: 4050 pid: 15134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379110:0:15191:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801315cb200/0xefc4487a018067f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d177c expref: 4050 pid: 15134 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379113:0:15191:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0001_UUID:15191:1788538584487104:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.379117:0:15191:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a000 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.379122:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1705683932.379128:0:15131:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34465 count 1 00010000:00010000:2.0:1705683932.379205:0:15131:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379210:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3d6a80/0xefc4487a018067d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1759 expref: 4050 pid: 15149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379213:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098487980/0xefc4487a01859b84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88c8 expref: 6003 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379216:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379216:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379217:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379226:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098487980/0xefc4487a01859b84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88c8 expref: 6003 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379230:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098487980/0xefc4487a01859b84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f88c8 expref: 6003 pid: 14248 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379234:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584487296:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.379243:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3d6a80/0xefc4487a018067d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1759 expref: 4050 pid: 15149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379246:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3d6a80/0xefc4487a018067d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1759 expref: 4050 pid: 15149 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379249:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584487360:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.379254:0:15131:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33af00 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.379265:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090135500/2, rc 0, transno 380852 00000100:00100000:2.0:1705683932.379269:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584484992:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.379274:0:15110:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379278:0:15110:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379281:0:15110:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379284:0:15110:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c35400/0xefc4487a0187820b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x869d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379289:0:15110:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:2.0:1705683932.379349:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090135f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3153:3082:x1788538584485312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6078us (6114us total) trans 4295348149 rc 0/0 00000100:00100000:2.0:1705683932.379352:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920577 00000004:00080000:2.0:1705683932.379419:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090137300/2, rc 0, transno 380855 00000100:00100000:2.0:1705683932.379421:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090137300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584485440:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.379570:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379571:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379575:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584487936 00000100:00100000:2.0:1705683932.379583:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379584:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379586:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920606 00000100:00100000:2.0:1705683932.379588:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073784b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3154:3083:x1788538584487872:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.379594:0:15189:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34470 count 1 00010000:00010000:2.0:1705683932.379653:0:15189:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379659:0:15189:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a57ef80/0xefc4487a018068c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d181d expref: 4050 pid: 15136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379662:0:15189:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dea7c00/0xefc4487a01859c48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f890e expref: 6004 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379665:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379666:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.379666:0:15189:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379674:0:15189:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dea7c00/0xefc4487a01859c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f890e expref: 6004 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379678:0:15189:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dea7c00/0xefc4487a01859c48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f890e expref: 6004 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379683:0:15189:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133632800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584488000:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.379699:0:15189:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a57ef80/0xefc4487a018068c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d181d expref: 4050 pid: 15136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.379702:0:15189:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a57ef80/0xefc4487a018068c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d181d expref: 4050 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.379706:0:15189:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133635a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584488064:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.379725:0:15189:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a900 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.379732:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379732:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379735:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920609 00000100:00100000:2.0:1705683932.379737:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073785f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3154:3083:x1788538584487936:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.379779:0:15110:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95b1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.379781:0:15110:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95b1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.379782:0:15110:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.379783:0:15110:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95b1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.379785:0:15110:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95b1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.379804:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073785f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3155:3083:x1788538584487936:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (258us total) trans 4295348153 rc 0/0 00000100:00100000:2.0:1705683932.379808:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920609 00000100:00100000:2.0:1705683932.379818:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379818:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.379822:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920610 00000100:00100000:2.0:1705683932.379825:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6004:16443:x1788538641007104:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1705683932.379830:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.379976:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131eba080/0xefc4487a018782eb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ee7 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379986:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbdb980/0xefc4487a017f37fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c97d8 expref: 4050 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.379990:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1705683932.379990:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1705683932.379991:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131eba080/0xefc4487a018782eb lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ee7 expref: 6005 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380000:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbdb980/0xefc4487a017f37fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c97d8 expref: 4050 pid: 9017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380005:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbdb980/0xefc4487a017f37fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2c97d8 expref: 4050 pid: 9017 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1705683932.380011:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584488128:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.380028:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880073fd6480 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.380045:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6006e00/2, rc 0, transno 380857 00000100:00100000:2.0:1705683932.380049:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6006e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584487936:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.380075:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380075:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380091:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413363 00000100:00100000:2.0:1705683932.380093:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880124095000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1789:7281:x1788538641006656:12345-192.168.203.41@tcp:36:mrename.0 00010000:00010000:2.0:1705683932.380105:0:14377:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1705683932.380111:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34f00/0xefc4487a0187827b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42cb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ea8 expref: 1789 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380119:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800958e9e00/0xefc4487a0187638e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42cb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3005a2 expref: 1788 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380124:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42cb:0x0].0x0 (ffff8800a1267300) 00010000:00010000:2.0:1705683932.380129:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878163 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e3f expref: 1787 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380133:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880136254500) 00010000:00010000:2.0:1705683932.380135:0:14377:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1705683932.380164:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.380168:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380171:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380229:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.380232:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380234:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380266:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.380269:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380271:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380318:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.380321:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380324:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380383:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.380385:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380387:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380417:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380420:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380422:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380424:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6f700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.380425:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380427:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380429:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42cb:0x0].0x0 (ffff88009afd8400) 00010000:00010000:2.0:1705683932.380430:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1705683932.380431:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380433:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187832a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x42cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380439:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380441:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380443:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380446:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6c000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.380447:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380449:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380451:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff88009afd8100) 00010000:00010000:2.0:1705683932.380452:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1705683932.380452:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380454:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878323 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380458:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380460:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380462:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380463:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013588d900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.380464:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380466:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380468:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88009afd8600) 00010000:00010000:2.0:1705683932.380469:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.380470:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380472:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d900/0xefc4487a0187831c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380477:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380479:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380481:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380483:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380485:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131eb8780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.380485:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380487:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380489:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.380490:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.380490:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380492:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131eb8780/0xefc4487a01878307 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380495:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380499:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380501:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380502:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013588d400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.380503:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380504:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380506:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88009afd8900) 00010000:00010000:2.0:1705683932.380507:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.380508:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.380509:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013588d400/0xefc4487a0187830e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00000100:00100000:2.0:1705683932.380528:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880124095000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1786:7281:x1788538641006656:12345-192.168.203.41@tcp:36:mrename.0 Request processed in 433us (1005us total) trans 0 rc -39/-39 00000100:00100000:2.0:1705683932.380530:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413363 00000100:00100000:2.0:1705683932.380629:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380630:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380632:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641007232 00000100:00100000:2.0:1705683932.380639:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380640:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.380642:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413365 00000100:00100000:2.0:1705683932.380643:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1786:7316:x1788538641007232:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:2.0:1705683932.380650:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.380654:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ed00/0xefc4487a01878338 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ef5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380666:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ed00/0xefc4487a01878338 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x438c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ef5 expref: 1787 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380671:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ed00/0xefc4487a01878338 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x438c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ef5 expref: 1787 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.380675:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438c:0x0].0x0 (ffff88008b2d5f00) 00010000:00010000:2.0:1705683932.380676:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1705683932.380676:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6ed00, rc 0) 00000100:00100000:2.0:1705683932.380685:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7316:x1788538641007232:12345-192.168.203.41@tcp:101:touch.0 Request processed in 41us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.380688:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413365 00000100:00100000:2.0:1705683932.380704:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584486336:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1705683932.380721:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x99f1:0x0]-[0x2c0000402:0x9b81:0x0] 00000100:00100000:2.0:1705683932.380884:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584487296:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.381192:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381193:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381196:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641007744 00000100:00100000:2.0:1705683932.381208:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381208:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381212:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413366 00000100:00100000:2.0:1705683932.381214:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1868:7313:x1788538641007744:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1705683932.381220:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.381247:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f480/0xefc4487a0187833f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300efc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381298:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.381302:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381305:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381328:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.381330:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381332:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.381355:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x3fe1:0x0]: returning size 4096 00010000:00010000:2.0:1705683932.381377:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381380:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381382:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381384:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381386:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6de00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.381386:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381389:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381392:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.381393:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.381394:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381396:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a01878346 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381400:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381402:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381404:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381406:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6c280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.381406:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381408:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381410:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff88009afd8500) 00010000:00010000:2.0:1705683932.381411:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.381411:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381413:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c280/0xefc4487a0187834d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381430:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f480/0xefc4487a0187833f lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300efc expref: 1870 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381433:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f480/0xefc4487a0187833f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300efc expref: 1870 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381437:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6f480, rc 0) 00000100:00100000:2.0:1705683932.381450:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1869:7313:x1788538641007744:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 236us (320us total) trans 4295084937 rc 301/301 00000100:00100000:2.0:1705683932.381453:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413366 00000100:00100000:2.0:1705683932.381459:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381459:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381461:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641008384 00000100:00100000:2.0:1705683932.381467:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381467:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381469:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413367 00000100:00100000:2.0:1705683932.381470:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6005a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1787:7265:x1788538641008384:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1705683932.381475:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.381478:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6e580/0xefc4487a0187835b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f03 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381514:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ca00/0xefc4487a01878362 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x4172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.381518:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ca00/0xefc4487a01878362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x4172:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.381521:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ca00/0xefc4487a01878362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x4172:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.381527:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4172:0x0]: returning size 4096 00010000:00010000:2.0:1705683932.381552:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6e580/0xefc4487a0187835b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f03 expref: 1790 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381557:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ca00/0xefc4487a01878362 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4172:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f03 expref: 1789 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381560:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00010000:00010000:2.0:1705683932.381561:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1705683932.381562:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6ca00, rc 0) 00000100:00100000:2.0:1705683932.381580:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6005a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1789:7265:x1788538641008384:12345-192.168.203.41@tcp:101:rm.0 Request processed in 109us (168us total) trans 4295084938 rc 0/0 00000100:00100000:2.0:1705683932.381582:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413367 00000100:00100000:2.0:1705683932.381598:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584487360:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.381606:0:15131:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.381611:0:15131:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.381612:0:15131:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.381612:0:15131:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381622:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584488128:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.381632:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131eba080/0xefc4487a018782eb lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ee7 expref: 6005 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.381639:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131eba080, rc 0) 00000100:00100000:2.0:1705683932.381654:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+6005:16443:x1788538641007104:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1828us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.381659:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920610 00000100:00100000:2.0:1705683932.381676:0:15189:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133632800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584488000:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.381681:0:15189:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133635a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584488064:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.381692:0:15189:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.381695:0:15189:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.381696:0:15189:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.381696:0:15189:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381856:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381857:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381861:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641008896 00000100:00100000:2.0:1705683932.381872:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381873:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381874:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641008960 00000100:00100000:2.0:1705683932.381881:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381882:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.381885:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920617 00000100:00100000:2.0:1705683932.381888:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880124097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4053:6496:x1788538641008960:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.381893:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.382187:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6e080/0xefc4487a01878377 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f11 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.382194:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9202:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.382200:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.382200:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.382202:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6e080/0xefc4487a01878377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f11 expref: 4053 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.382210:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6e080/0xefc4487a01878377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f11 expref: 4053 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.382213:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6e080, rc 0) 00000100:00100000:2.0:1705683932.382225:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880124097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4053:6496:x1788538641008960:12345-192.168.203.41@tcp:101:dd.0 Request processed in 337us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.382228:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920617 00000100:00100000:2.0:1705683932.382311:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+1040:9011:x1788538584486400:12345-0@lo:5:osp-pre-0-1.0 Request processed in 5197us (5279us total) trans 4295340559 rc 0/0 00000100:00100000:2.0:1705683932.382314:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920591 00000100:00100000:2.0:1705683932.382423:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.382424:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.382426:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584488768 00000100:00100000:2.0:1705683932.382433:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.382434:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.382436:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920618 00000100:00100000:2.0:1705683932.382438:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073784600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+1040:9011:x1788538584488768:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1705683932.382451:0:15223:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 35842 00000100:00100000:2.0:1705683932.383882:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073784600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+1041:9011:x1788538584488768:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1442us (1477us total) trans 4295340560 rc 0/0 00000100:00100000:2.0:1705683932.383886:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920618 00000100:00100000:2.0:1705683932.383984:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.383985:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.383989:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413370 00000100:00100000:2.0:1705683932.383991:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6000500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1917:7185:x1788538641009856:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1705683932.383996:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.384005:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a01878393 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f26 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384051:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6c780/0xefc4487a0187839a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.384055:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6c780/0xefc4487a0187839a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.384058:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6c780/0xefc4487a0187839a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 00000004:00200000:2.0:1705683932.384062:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000402:0x438c:0x0]: returning size 4096 00010000:00010000:2.0:1705683932.384111:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a01878393 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f26 expref: 1920 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384120:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6c780/0xefc4487a0187839a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f26 expref: 1919 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384124:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800984f3800) 00010000:00010000:2.0:1705683932.384126:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1705683932.384127:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6c780, rc 0) 00000100:00100000:2.0:1705683932.384142:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6000500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1919:7185:x1788538641009856:12345-192.168.203.41@tcp:101:rm.0 Request processed in 150us (208us total) trans 4295091433 rc 0/0 00000100:00100000:2.0:1705683932.384147:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413370 00010000:00010000:2.0:1705683932.384222:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.384225:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384229:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131eb9680 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.384230:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384233:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384240:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384242:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131eb9680/0xefc4487a018782ba lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384249:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.384250:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.384251:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.384253:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384254:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384257:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584489152 00000100:00100000:2.0:1705683932.384267:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384267:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384270:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920621 00000100:00100000:2.0:1705683932.384271:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88007348b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+1041:9011:x1788538584489152:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1705683932.384281:0:15223:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 35906 00010000:00010000:3.0:1705683932.384468:0:14202:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384471:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.384471:0:14202:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384473:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b8a2080/0xefc4487a018782c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384473:0:14202:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009dc8c000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.384474:0:14202:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT1 00010000:00010000:3.0:1705683932.384476:0:14202:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384477:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009b8a2080 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.384478:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b8a2080/0xefc4487a018782c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384479:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.384479:0:14202:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.384480:0:14202:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT1 00010000:00010000:3.0:1705683932.384482:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009dc8c000/0xefc4487a018783bd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384484:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b8a2080/0xefc4487a018782c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384485:0:14202:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT1 00010000:00010000:3.0:1705683932.384487:0:14202:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384489:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b8a2080/0xefc4487a018782c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384489:0:14202:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384491:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8a2080/0xefc4487a018782c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384491:0:14202:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c37480 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.384492:0:14202:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT1 00010000:00010000:3.0:1705683932.384494:0:14202:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384498:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.384498:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384498:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff88009bb41600) 00010000:00010000:2.0:1705683932.384499:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384499:0:14202:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.384499:0:14202:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT1 00010000:00010000:3.0:1705683932.384501:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c37480/0xefc4487a018783c4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT1 00010000:00010000:2.0:1705683932.384503:0:15131:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384506:0:15131:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384509:0:15131:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384511:0:15131:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131eb8a00/0xefc4487a018782c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384516:0:15131:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.384516:0:14202:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880134dbb480/0xefc4487a018783b6 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f2d expref: 1873 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384519:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134dbb480/0xefc4487a018783b6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f2d expref: 1873 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384523:0:14202:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134dbb480, rc 0) 00000100:00100000:3.0:1705683932.384533:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1872:7313:x1788538641009984:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 259us (309us total) trans 4295084942 rc 301/301 00000100:00100000:3.0:1705683932.384536:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413371 00000100:00100000:2.0:1705683932.384579:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3161:3081:x1788538584486784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5683us (5731us total) trans 4295348160 rc 0/0 00000100:00100000:2.0:1705683932.384585:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920598 00000100:00100000:2.0:1705683932.384591:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384591:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384594:0:15131:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584489280 00000100:00100000:2.0:1705683932.384600:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384601:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.384602:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920623 00000100:00100000:2.0:1705683932.384604:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6002d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:lustre-MDT0001-mdtlov_UUID+3161:3081:x1788538584489280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.384610:0:15131:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34473 count 1 00010000:00010000:2.0:1705683932.384755:0:15131:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384761:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131848a00/0xefc4487a0180694c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1886 expref: 4044 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.384764:0:15131:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dea5e00/0xefc4487a01859c64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8938 expref: 5999 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.384767:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.384768:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.384768:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384777:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dea5e00/0xefc4487a01859c64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8938 expref: 5999 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.384782:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dea5e00/0xefc4487a01859c64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8938 expref: 5999 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.384789:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133635a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584489408:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.384790:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.384792:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a018782cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384796:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366cf00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.384797:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a018782cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384800:0:15131:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131848a00/0xefc4487a0180694c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1886 expref: 4044 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.384800:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a018782cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384803:0:15131:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131848a00/0xefc4487a0180694c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1886 expref: 4044 pid: 14209 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.384806:0:15131:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133632800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584489472:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.384808:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a018782cf lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.384810:0:15131:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.384811:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366cf00/0xefc4487a018782cf lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384823:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384823:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384824:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.384846:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+3163:3084:x1788538584487232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5643us (5665us total) trans 4295348159 rc 0/0 00000100:00100000:2.0:1705683932.384849:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920602 00010000:00010000:2.0:1705683932.384858:0:15189:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384861:0:15189:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384864:0:15189:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384867:0:15189:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.384880:0:15189:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.384883:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.384885:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.384888:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.384888:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131ebad00 already unused, calling callback (ffffffffa0664e00) 00000100:00100000:2.0:1705683932.384889:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.384889:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.384891:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584489536 00010000:00010000:3.0:1705683932.384891:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384897:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.384899:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131ebad00/0xefc4487a018782d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.384901:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920625 00000100:00100000:2.0:1705683932.384903:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6000f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+3163:3083:x1788538584489536:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.384906:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384907:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.384907:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1705683932.384908:0:14216:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34474 count 1 00010000:00010000:2.0:1705683932.385001:0:14216:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385006:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d14280/0xefc4487a0180697d lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d18a9 expref: 4044 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385010:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be3980/0xefc4487a01859c6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8946 expref: 5999 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385013:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385013:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385014:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385022:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be3980/0xefc4487a01859c6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8946 expref: 5999 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385026:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be3980/0xefc4487a01859c6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8946 expref: 5999 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.385033:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584489728:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.385044:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d14280/0xefc4487a0180697d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d18a9 expref: 4044 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385047:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d14280/0xefc4487a0180697d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d18a9 expref: 4044 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.385050:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584489792:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.385054:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.385059:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.385060:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366f480/0xefc4487a018782f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385063:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366f480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.385064:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366f480/0xefc4487a018782f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385067:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366f480/0xefc4487a018782f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385072:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366f480/0xefc4487a018782f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385088:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366f480/0xefc4487a018782f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.385115:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.385116:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.385119:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584489856 00000100:00100000:3.0:1705683932.385126:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.385127:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.385129:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920628 00000100:00100000:3.0:1705683932.385131:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3165:3081:x1788538584489856:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.385161:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.385162:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.385163:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.385168:0:15148:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95b6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.385169:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95b6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.385170:0:15148:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.385170:0:15148:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95b6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.385171:0:15148:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95b6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.385187:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3168:3081:x1788538584489856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (79us total) trans 4295348165 rc 0/0 00000100:00100000:3.0:1705683932.385192:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920628 00000100:00100000:2.0:1705683932.385218:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073784b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3167:3083:x1788538584487872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5629us (5718us total) trans 4295348166 rc 0/0 00000100:00100000:2.0:1705683932.385221:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920606 00000004:00080000:2.0:1705683932.385236:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013713df00/2, rc 0, transno 380870 00000100:00100000:2.0:1705683932.385239:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88013713df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584487872:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.385442:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.385447:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008187a800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584490240:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.385458:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.385467:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385467:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385470:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584490240 00000100:00100000:2.0:1705683932.385477:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385477:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385480:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920631 00000100:00100000:2.0:1705683932.385481:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3531:6496:x1788538641010112:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.385486:0:15189:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.385609:0:15189:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d5db80/0xefc4487a018783ee lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f3b expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.385616:0:15189:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1705683932.385621:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385622:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385624:0:15189:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d5db80/0xefc4487a018783ee lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f3b expref: 3530 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385631:0:15189:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d5db80/0xefc4487a018783ee lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f3b expref: 3530 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385635:0:15189:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5db80, rc 0) 00000100:00100000:2.0:1705683932.385642:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3530:6496:x1788538641010112:12345-192.168.203.41@tcp:101:dd.0 Request processed in 160us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.385645:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920631 00000100:00100000:2.0:1705683932.385650:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385651:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.385653:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920633 00000100:00100000:2.0:1705683932.385655:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009025e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3169:3081:x1788538584490304:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.385659:0:15189:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34477 count 1 00000004:00080000:2.0:1705683932.385738:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187a800/2, rc 0, transno 380871 00000100:00100000:2.0:1705683932.385742:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008187a800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584490240:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.385749:0:15189:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385754:0:15189:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013184aa80/0xefc4487a018069df lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1912 expref: 4043 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385757:0:15189:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf4c280/0xefc4487a01859c80 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8970 expref: 5999 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385760:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385760:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.385761:0:15189:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.385769:0:15189:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf4c280/0xefc4487a01859c80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8970 expref: 5999 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385772:0:15189:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cf4c280/0xefc4487a01859c80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8970 expref: 5999 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.385776:0:15189:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584490368:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.385785:0:15189:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013184aa80/0xefc4487a018069df lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1912 expref: 4043 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.385789:0:15189:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013184aa80/0xefc4487a018069df lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1912 expref: 4043 pid: 14209 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.385792:0:15189:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584490432:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.385796:0:15189:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a480 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.386149:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090258a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584490752:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.386163:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.386168:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073780a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3170:10725:x1788538584488832:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3707us (3731us total) trans 4295348169 rc 0/0 00000100:00100000:3.0:1705683932.386172:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920619 00000100:00100000:2.0:1705683932.386175:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.386175:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386186:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073781900 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584488832:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1705683932.386190:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x99f1:0x0]-[0x2c0000402:0x9c01:0x0] 00000100:00100000:3.0:1705683932.386198:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386198:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386201:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641010304 00000100:00100000:3.0:1705683932.386208:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386208:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386209:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641010432 00000100:00100000:3.0:1705683932.386213:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386213:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386216:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413372 00000100:00100000:3.0:1705683932.386217:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1791:7284:x1788538641010304:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:3.0:1705683932.386223:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.386253:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878418 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f50 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386298:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386302:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386306:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386340:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386343:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386345:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386376:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386379:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386381:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:3.0:1705683932.386392:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41ef:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.386393:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.386398:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386402:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386404:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386406:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386408:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386409:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c35180 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.386410:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386412:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386415:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.386416:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.386417:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386419:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c35180/0xefc4487a0187841f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386423:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386425:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386427:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386429:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0c34a00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.386430:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386431:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386433:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff88009bb41100) 00010000:00010000:3.0:1705683932.386434:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.386435:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386436:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c34a00/0xefc4487a01878426 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.386452:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0c36a80/0xefc4487a01878418 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f50 expref: 1793 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386457:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f50 expref: 1792 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386459:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff88009bb41c00) 00010000:00010000:3.0:1705683932.386460:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.386460:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c9e00, rc 0) 00000100:00100000:3.0:1705683932.386469:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1792:7284:x1788538641010304:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 250us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.386471:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413372 00000100:00100000:3.0:1705683932.386477:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386477:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.386479:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413373 00000100:00100000:3.0:1705683932.386481:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1919:7185:x1788538641010432:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:3.0:1705683932.386485:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.386491:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a0187843b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f5e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386519:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386523:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386526:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386588:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386590:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386592:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386614:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386617:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386619:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00200000:3.0:1705683932.386632:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000402:0x438d:0x0]: returning size 5 00000004:00200000:3.0:1705683932.386633:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.386638:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386641:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386643:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386645:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386647:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386649:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386651:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998caa80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.386651:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386653:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386656:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800984f3800) 00010000:00010000:3.0:1705683932.386657:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.386657:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386659:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998caa80/0xefc4487a01878442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386664:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386666:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386668:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386670:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cad00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.386671:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386672:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386674:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x39 (ffff88009bb41900) 00010000:00010000:3.0:1705683932.386675:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.386675:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386677:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cad00/0xefc4487a01878449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.386691:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998ca080/0xefc4487a0187843b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f5e expref: 1921 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386695:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f5e expref: 1920 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386698:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438d:0x0].0x0 (ffff880095889200) 00010000:00010000:3.0:1705683932.386699:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1705683932.386700:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c9400, rc 0) 00000100:00100000:3.0:1705683932.386727:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7185:x1788538641010432:12345-192.168.203.41@tcp:101:rm.0 Request processed in 245us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.386730:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413373 00010000:00010000:3.0:1705683932.386749:0:15220:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134dbb200/0xefc4487a01878315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386753:0:15220:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134dbb200/0xefc4487a01878315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386756:0:15220:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134dbb200/0xefc4487a01878315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386758:0:15220:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134dbb200/0xefc4487a01878315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386767:0:15220:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1705683932.386831:0:15220:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6005f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_107:lustre-MDT0001-mdtlov_UUID+3171:3081:x1788538584488192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6654us (6706us total) trans 4295348170 rc 0/0 00000100:00100000:3.0:1705683932.386834:0:15220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920612 00010000:00010000:3.0:1705683932.386846:0:15135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134db8280/0xefc4487a01878331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386850:0:15135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134db8280/0xefc4487a01878331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386852:0:15135:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134db8280/0xefc4487a01878331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386855:0:15135:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134db8280/0xefc4487a01878331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.386860:0:15135:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.386879:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88007348b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+1042:9011:x1788538584489152:12345-0@lo:5:osp-pre-0-1.0 Request processed in 2606us (2631us total) trans 4295340561 rc 0/0 00000100:00100000:2.0:1705683932.386882:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920621 00000100:00100000:3.0:1705683932.386884:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073780f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584489152:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1705683932.386889:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8c81:0x0] 00000100:00100000:3.0:1705683932.386933:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3171:3084:x1788538584488576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6393us (6412us total) trans 4295348171 rc 0/0 00000100:00100000:3.0:1705683932.386936:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920614 00000100:00100000:2.0:1705683932.386985:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.386986:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.386989:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584490944 00000100:00100000:2.0:1705683932.386997:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.386998:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.386999:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491008 00000100:00100000:2.0:1705683932.387002:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387003:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387004:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920639 00000100:00100000:2.0:1705683932.387006:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009025ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3172:3083:x1788538584490944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.387015:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073787300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584491072:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1705683932.387024:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.387030:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b73c0 going to sleep for 161 seconds 00000100:00100000:3.0:1705683932.387039:0:10725:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073785f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584491136:0@lo:5:osp-pre-1-1.0 00002000:00010000:2.0:1705683932.387043:0:15169:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387044:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95b9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387045:0:15169:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387046:0:15169:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95b9:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1705683932.387046:0:10725:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1705683932.387047:0:15169:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.387049:0:10725:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b79c0 going to sleep for 161 seconds 00000100:00100000:3.0:1705683932.387053:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387053:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387055:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491072 00000100:00100000:2.0:1705683932.387061:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009025ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3173:3083:x1788538584490944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 54us (126us total) trans 4295348172 rc 0/0 00000100:00100000:3.0:1705683932.387061:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387062:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387063:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491136 00000100:00100000:2.0:1705683932.387064:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920639 00000100:00100000:3.0:1705683932.387067:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387068:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387069:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387069:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387069:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920640 00000100:00100000:2.0:1705683932.387071:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920641 00000100:00100000:3.0:1705683932.387071:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3173:3081:x1788538584491008:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.387073:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073783200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+1042:9011:x1788538584491072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1705683932.387090:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34479 count 1 00002000:00080000:2.0:1705683932.387096:0:15169:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 35970 00010000:00010000:3.0:1705683932.387180:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.387186:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013184ad00/0xefc4487a01806a25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1951 expref: 4045 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.387190:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be1e00/0xefc4487a01859c8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8993 expref: 6000 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.387192:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.387193:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.387193:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.387201:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be1e00/0xefc4487a01859c8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8993 expref: 6000 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.387205:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be1e00/0xefc4487a01859c8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8993 expref: 6000 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.387209:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073783c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584491264:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.387224:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013184ad00/0xefc4487a01806a25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1951 expref: 4045 pid: 14209 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.387227:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013184ad00/0xefc4487a01806a25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1951 expref: 4045 pid: 14209 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.387230:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073784b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584491328:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.387236:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b7300 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.387243:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387243:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387247:0:15118:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491200 00000100:00100000:3.0:1705683932.387254:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387254:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.387256:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920642 00000100:00100000:3.0:1705683932.387257:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073784600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0001-mdtlov_UUID+3174:10725:x1788538584491136:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1705683932.387260:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584489792:192.168.203.41@tcp:104: 00002000:00080000:3.0:1705683932.387265:0:15118:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0001: reserve 128 objects in group 0x2c0000402 at 39938 00000100:00100000:2.0:1705683932.387267:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387267:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387270:0:15187:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920643 00000100:00100000:2.0:1705683932.387272:0:15187:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0001-mdtlov_UUID+3174:3082:x1788538584491200:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.387307:0:15187:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95ba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387308:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95ba:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387309:0:15187:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387310:0:15187:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95ba:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.387310:0:15187:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95ba:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.387325:0:15187:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0001-mdtlov_UUID+3175:3082:x1788538584491200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 52us (111us total) trans 4295348173 rc 0/0 00000100:00100000:2.0:1705683932.387329:0:15187:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920643 00000100:00100000:2.0:1705683932.387341:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584489728:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.387350:0:14216:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.387354:0:14216:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.387354:0:14216:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.387355:0:14216:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.387361:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133635a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584489408:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.387364:0:15131:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133632800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_050:lustre-OST0001_UUID:15131:1788538584489472:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.387370:0:15131:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.387373:0:15131:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.387373:0:15131:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.387373:0:15131:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.388593:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073783200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+1043:9011:x1788538584491072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1519us (1567us total) trans 4295340562 rc 0/0 00000100:00100000:2.0:1705683932.388596:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920641 00000100:00100000:2.0:1705683932.388610:0:15189:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584490368:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.388613:0:15189:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013184aa80/0xefc4487a018069df lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1912 expref: 4042 pid: 14209 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.388621:0:15189:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_096:lustre-OST0001_UUID:15189:1788538584490432:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.388629:0:15189:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.388632:0:15189:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.388632:0:15189:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.388633:0:15189:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.388734:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1705683932.388736:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388740:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6fc00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.388741:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388744:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388750:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388753:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6fc00/0xefc4487a018783d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388761:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.388761:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388767:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6cf00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.388768:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388770:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388773:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388775:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6cf00/0xefc4487a018783d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.388781:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.388782:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.388782:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.388785:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.388794:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073787300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584491072:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1705683932.388798:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8cc1:0x0] 00000100:00100000:3.0:1705683932.388836:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073783c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584491264:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.388839:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073784b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584491328:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.388845:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.388848:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.388849:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.388849:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.388867:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073784b00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584491776:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1705683932.388877:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.388883:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b7300 going to sleep for 161 seconds 00000100:00100000:3.0:1705683932.388886:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.388887:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.388889:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491776 00000100:00100000:3.0:1705683932.388898:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.388898:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.388902:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920645 00010000:00010000:2.0:1705683932.388903:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1705683932.388903:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+1043:9011:x1788538584491776:12345-0@lo:5:osp-pre-0-1.0 00010000:00010000:2.0:1705683932.388905:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007366de00/0xefc4487a018783e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388909:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88007366de00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.388910:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366de00/0xefc4487a018783e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1705683932.388912:0:14216:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 36034 00010000:00010000:2.0:1705683932.388913:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007366de00/0xefc4487a018783e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388918:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007366de00/0xefc4487a018783e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388921:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007366de00/0xefc4487a018783e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388927:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.388927:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.388928:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.388930:0:15189:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388936:0:15189:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388938:0:15189:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388941:0:15189:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5e080/0xefc4487a018783f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.388946:0:15189:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.388999:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009025e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3176:3081:x1788538584490304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3343us (3441us total) trans 4295348177 rc 0/0 00000100:00100000:2.0:1705683932.389002:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920633 00000100:00100000:2.0:1705683932.389007:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389008:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389010:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491840 00000100:00100000:2.0:1705683932.389016:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389017:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389018:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491904 00000100:00100000:2.0:1705683932.389021:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389022:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389023:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584491968 00000100:00100000:2.0:1705683932.389026:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389027:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389028:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920646 00000100:00100000:2.0:1705683932.389030:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090258500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3178:3083:x1788538584491840:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1705683932.389150:0:15189:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95bb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.389151:0:15189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95bb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.389152:0:15189:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95bb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.389153:0:15189:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95bb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.389154:0:15189:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95bb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.389167:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090258500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3180:3083:x1788538584491840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 135us (215us total) trans 4295348178 rc 0/0 00000100:00100000:2.0:1705683932.389169:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920646 00000100:00100000:2.0:1705683932.389349:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389350:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389354:0:15187:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584492352 00000100:00100000:2.0:1705683932.389363:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389363:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.389365:0:15187:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920651 00000100:00100000:2.0:1705683932.389367:0:15187:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0001-mdtlov_UUID+3182:3081:x1788538584492288:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.389374:0:15187:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34483 count 1 00010000:00010000:2.0:1705683932.389439:0:15187:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389444:0:15187:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136160280/0xefc4487a01806a87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d19cf expref: 4038 pid: 14280 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.389448:0:15187:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce38f00/0xefc4487a01859d9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f89e0 expref: 5993 pid: 15220 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.389450:0:15187:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.389451:0:15187:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.389452:0:15187:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389463:0:15187:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce38f00/0xefc4487a01859d9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f89e0 expref: 5993 pid: 15220 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.389473:0:15187:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ce38f00/0xefc4487a01859d9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f89e0 expref: 5993 pid: 15220 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.389480:0:15187:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:15187:1788538584492416:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.389501:0:15187:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136160280/0xefc4487a01806a87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d19cf expref: 4038 pid: 14280 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.389506:0:15187:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136160280/0xefc4487a01806a87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d19cf expref: 4038 pid: 14280 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.389511:0:15187:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:15187:1788538584492544:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.389519:0:15187:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.389843:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389846:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389849:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389852:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.389860:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1705683932.389918:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3183:3081:x1788538584491008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2846us (2936us total) trans 4295348183 rc 0/0 00000100:00100000:2.0:1705683932.389921:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920640 00000004:00080000:2.0:1705683932.389934:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090259900/2, rc 0, transno 380887 00000100:00100000:2.0:1705683932.389935:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090259900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584491008:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.390100:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.390101:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390105:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cb200 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.390106:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390109:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390114:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390117:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800998cb200/0xefc4487a01878457 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390124:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.390125:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.390125:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.390230:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073783c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+1044:9011:x1788538584491776:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1325us (1352us total) trans 4295340563 rc 0/0 00000100:00100000:3.0:1705683932.390234:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920645 00000100:00100000:2.0:1705683932.390237:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073784b00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584491776:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1705683932.390238:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390239:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.390240:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8d01:0x0] 00000100:00100000:3.0:1705683932.390241:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641011776 00000100:00100000:3.0:1705683932.390252:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390253:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390253:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390253:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390256:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920654 00000100:00100000:2.0:1705683932.390257:0:14202:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641011904 00000100:00100000:3.0:1705683932.390257:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bcb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3445:6521:x1788538641011776:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.390261:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1705683932.390265:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390266:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390267:0:14202:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641011968 00000100:00100000:2.0:1705683932.390272:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390272:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390275:0:14202:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413374 00000100:00100000:2.0:1705683932.390277:0:14202:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1792:7284:x1788538641011904:12345-192.168.203.41@tcp:36:mkdir.0 00010000:00010000:2.0:1705683932.390292:0:14202:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1705683932.390298:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9e00/0xefc4487a01878434 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f50 expref: 1792 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390305:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff88009bb41c00) 00010000:00010000:2.0:1705683932.390310:0:14202:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.390342:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1791:7284:x1788538641011904:12345-192.168.203.41@tcp:36:mkdir.0 Request processed in 64us (111us total) trans 0 rc -17/-17 00000100:00100000:2.0:1705683932.390345:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413374 00000100:00100000:2.0:1705683932.390350:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390350:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390352:0:14202:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641012096 00000100:00100000:2.0:1705683932.390358:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390358:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390360:0:14202:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413375 00000100:00100000:2.0:1705683932.390362:0:14202:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bee00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7295:x1788538641011968:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:2.0:1705683932.390366:0:14202:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.390372:0:14202:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d680/0xefc4487a01878481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f73 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390405:0:14202:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390410:0:14202:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390413:0:14202:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390444:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800998c8000/0xefc4487a0187848f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f6c expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.390451:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.390456:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.390457:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.390459:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800998c8000/0xefc4487a0187848f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f6c expref: 3446 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.390464:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800998c8000/0xefc4487a0187848f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f6c expref: 3446 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.390468:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998c8000, rc 0) 00000100:00100000:3.0:1705683932.390475:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980bcb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3446:6521:x1788538641011776:12345-192.168.203.41@tcp:101:dd.0 Request processed in 217us (289us total) trans 0 rc 0/0 00010000:00010000:2.0:1705683932.390476:0:14202:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14202 initiator: MDT0 00000100:00100000:3.0:1705683932.390477:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920654 00010000:00010000:2.0:1705683932.390479:0:14202:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390481:0:14202:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14202 initiator: MDT0 00000100:00100000:3.0:1705683932.390486:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390487:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390489:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641012352 00010000:00010000:2.0:1705683932.390493:0:14202:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390495:0:14202:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390497:0:14202:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14202 initiator: MDT0 00000100:00100000:3.0:1705683932.390497:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390497:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.390499:0:14202:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT0 00000100:00100000:3.0:1705683932.390499:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413376 00010000:00010000:2.0:1705683932.390501:0:14202:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5c500 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:3.0:1705683932.390501:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bda00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1791:7265:x1788538641012096:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:2.0:1705683932.390503:0:14202:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390507:0:14202:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390510:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11f:0x0].0x0 (ffff880097f3af00) 00010000:00010000:2.0:1705683932.390511:0:14202:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.390512:0:14202:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390512:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1705683932.390514:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390518:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134dbb700/0xefc4487a018783af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4175:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f18 expref: 1791 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390519:0:14202:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390520:0:14202:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390522:0:14202:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390523:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4175:0x0].0x0 (ffff8800a0529600) 00010000:00010000:2.0:1705683932.390524:0:14202:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5d900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.390525:0:14202:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390526:0:14202:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390527:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d560280/0xefc4487a01877f4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d89 expref: 1790 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390529:0:14202:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11f:0x0].0x37 (ffff8800a15c5d00) 00010000:00010000:2.0:1705683932.390529:0:14202:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.390530:0:14202:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT0 00010000:00010000:2.0:1705683932.390532:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d900/0xefc4487a01878496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14202 initiator: MDT0 00010000:00010000:3.0:1705683932.390539:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00010000:00010000:3.0:1705683932.390540:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.390548:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:2.0:1705683932.390549:0:14202:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d680/0xefc4487a01878481 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f73 expref: 1921 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390552:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d680/0xefc4487a01878481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f73 expref: 1921 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.390553:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390555:0:14202:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5d680, rc 0) 00010000:00010000:3.0:1705683932.390556:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:2.0:1705683932.390563:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980bee00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7295:x1788538641011968:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 201us (319us total) trans 0 rc 301/301 00000100:00100000:2.0:1705683932.390566:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413375 00000100:00100000:2.0:1705683932.390572:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390572:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.390574:0:14202:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413377 00000100:00100000:2.0:1705683932.390576:0:14202:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980b9400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1873:7323:x1788538641012352:12345-192.168.203.41@tcp:36:mkdir.0 00000100:00100000:2.0:1705683932.390606:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980b9400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1873:7323:x1788538641012352:12345-192.168.203.41@tcp:36:mkdir.0 Request processed in 29us (183us total) trans 0 rc -17/-17 00000100:00100000:2.0:1705683932.390608:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413377 00010000:00010000:3.0:1705683932.390617:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018784a4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x4172:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.390619:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018784a4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4172:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390621:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018784a4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4172:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390642:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.390645:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390647:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390738:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.390740:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a0187845e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1705683932.390743:0:6531:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1050, 64 off75456 00010000:00010000:2.0:1705683932.390745:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad2300 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.390747:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a0187845e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390751:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a0187845e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.390761:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a0187845e lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.390763:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:2.0:1705683932.390764:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cad2300/0xefc4487a0187845e lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.390766:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390770:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390774:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390776:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.390776:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.390776:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390777:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.390778:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390783:0:6531:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.390789:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390791:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390793:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390795:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.390795:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c9680 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.390796:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390797:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390798:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390800:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4175:0x0].0x0 (ffff8800a0529600) 00010000:00010000:3.0:1705683932.390801:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1705683932.390802:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c8500 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.390802:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 2/0,0 mode: --/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390804:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390804:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a018784ab lrc: 0/0,0 mode: --/EX res: [0x240000404:0x4175:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390807:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390813:0:6522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4175:0x0].0x0 (ffff8800a0529600) 00010000:00010000:2.0:1705683932.390814:0:6522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1705683932.390816:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390819:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c8500/0xefc4487a018784b2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x4175:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 00010000:00010000:2.0:1705683932.390827:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.390827:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.390829:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.390845:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390848:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390850:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390852:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390853:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.390854:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390856:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390858:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00010000:00010000:3.0:1705683932.390859:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.390860:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390862:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a0187849d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x4172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000004:00010000:3.0:1705683932.390865:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8800980bda00 reply state ffff880099be2000 transno 4295084944 ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018784a4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4172:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390868:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cb980/0xefc4487a018784a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x4172:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.390870:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x3631 (ffff88009bb41a00) 00010000:00010000:3.0:1705683932.390872:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1705683932.390884:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980bda00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1791:7265:x1788538641012096:12345-192.168.203.41@tcp:36:rm.0 Request processed in 381us (603us total) trans 4295084944 rc 0/0 00000100:00100000:3.0:1705683932.390887:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413376 00000100:00100000:3.0:1705683932.390956:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073785f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584491136:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1705683932.390960:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x99f1:0x0]-[0x2c0000402:0x9c81:0x0] 00000100:00100000:3.0:1705683932.390974:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390974:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390978:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641012608 00000100:00100000:3.0:1705683932.390987:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390987:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.390990:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413378 00000100:00100000:3.0:1705683932.390991:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7185:x1788538641012608:12345-192.168.203.41@tcp:36:rm.0 00000100:00100000:2.0:1705683932.390997:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6000a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584492864:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.391002:0:14222:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1705683932.391008:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9400/0xefc4487a01878450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x438d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f5e expref: 1920 pid: 6531 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.391012:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1705683932.391013:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438d:0x0].0x0 (ffff880095889200) 00010000:00010000:3.0:1705683932.391017:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b131e00/0xefc4487a0187812b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x438c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300df2 expref: 1919 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.391020:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800984f3800) 00000100:00100000:2.0:1705683932.391021:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1705683932.391021:0:14222:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1705683932.391023:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6001400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584492928:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.391030:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391033:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391038:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391045:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.391112:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584492992:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1705683932.391123:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.391127:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 161 seconds 00000100:00100000:2.0:1705683932.391131:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391132:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391134:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584492992 00010000:00010000:3.0:1705683932.391139:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8780/0xefc4487a018784c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x438c:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391141:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391142:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.391143:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8780/0xefc4487a018784c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391144:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920658 00000100:00100000:2.0:1705683932.391145:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980be900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3186:3083:x1788538584492800:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.391146:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8780/0xefc4487a018784c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391169:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391172:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391175:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00002000:00010000:2.0:1705683932.391184:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391186:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95bf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391186:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391187:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95bf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391188:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.391201:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980be900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3187:3083:x1788538584492800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (170us total) trans 4295348186 rc 0/0 00000100:00100000:2.0:1705683932.391204:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920658 00000100:00100000:2.0:1705683932.391208:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391209:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391211:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920659 00000100:00100000:2.0:1705683932.391212:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3186:3081:x1788538584492928:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:3.0:1705683932.391233:0:14222:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].10156, 64 off658176 00002000:00010000:2.0:1705683932.391243:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391244:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391245:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391245:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.391246:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c0:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1705683932.391250:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391253:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391256:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391259:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391260:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3187:3081:x1788538584492928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 48us (215us total) trans 4295348187 rc 0/0 00010000:00010000:3.0:1705683932.391262:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391263:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920659 00010000:00010000:3.0:1705683932.391264:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d900/0xefc4487a018784e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x438d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391269:0:14222:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1705683932.391274:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6001400/2, rc 0, transno 380891 00010000:00010000:3.0:1705683932.391274:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391276:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.391277:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6001400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584492928:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.391278:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391280:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013588d400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.391281:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391283:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391285:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438d:0x0].0x0 (ffff880095889200) 00010000:00010000:3.0:1705683932.391286:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.391287:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391289:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013588d400/0xefc4487a018784ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x438d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391326:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391331:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391334:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391336:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391338:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cb700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.391339:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391341:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391343:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800984f3800) 00010000:00010000:3.0:1705683932.391344:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.391345:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391346:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998cb700/0xefc4487a018784c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x438c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00000004:00010000:3.0:1705683932.391349:0:14222:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8800980bd500 reply state ffff880099be1000 transno 4295091434 ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8780/0xefc4487a018784c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391353:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8780/0xefc4487a018784c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x438c:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.391355:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x39 (ffff88009e8c4800) 00010000:00010000:3.0:1705683932.391356:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1705683932.391373:0:10725:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073780a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584493440:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1705683932.391385:0:10725:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.391393:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.391393:0:10725:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b7300 going to sleep for 161 seconds 00000100:00100000:2.0:1705683932.391394:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391398:0:14236:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584493440 00000100:00100000:3.0:1705683932.391400:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7185:x1788538641012608:12345-192.168.203.41@tcp:36:rm.0 Request processed in 408us (433us total) trans 4295091434 rc 0/0 00000100:00100000:3.0:1705683932.391404:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413378 00000100:00100000:2.0:1705683932.391406:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391406:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.391408:0:14236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920661 00000100:00100000:2.0:1705683932.391410:0:14236:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3187:10725:x1788538584493440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1705683932.391419:0:14236:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0001: reserve 128 objects in group 0x2c0000402 at 40066 00000100:00100000:3.0:1705683932.391550:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.391550:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.391553:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641012672 00000100:00100000:3.0:1705683932.391560:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.391560:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.391563:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920662 00000100:00100000:3.0:1705683932.391564:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3446:16415:x1788538641012672:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.391568:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.391739:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d6e580/0xefc4487a018784ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f81 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.391748:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008745a080/0xefc4487a0181d1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9448 expref: 3530 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.391751:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.391752:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.391753:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d6e580/0xefc4487a018784ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f81 expref: 3447 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.391761:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008745a080/0xefc4487a0181d1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9448 expref: 3531 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.391764:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008745a080/0xefc4487a0181d1c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9448 expref: 3531 pid: 15220 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.391769:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584493504:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.391778:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff880094e89180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.392125:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392126:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392130:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584493376 00000100:00100000:3.0:1705683932.392142:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392143:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392144:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584493312 00000100:00100000:2.0:1705683932.392145:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.392145:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392148:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.392149:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920664 00000100:00100000:3.0:1705683932.392149:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.392152:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3189:3084:x1788538584493376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.392152:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920665 00000100:00100000:3.0:1705683932.392154:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebb9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3189:3084:x1788538584493312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.392160:0:15110:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34486 count 1 00002000:00010000:2.0:1705683932.392184:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.392185:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.392186:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.392187:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.392188:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.392208:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3191:3084:x1788538584493376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 56us (89us total) trans 4295348189 rc 0/0 00000100:00100000:2.0:1705683932.392213:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920664 00010000:00010000:3.0:1705683932.392226:0:15110:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392232:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1328280/0xefc4487a01806b13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a54 expref: 4037 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392235:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd7d180/0xefc4487a01859f35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a11 expref: 5991 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392238:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.392238:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.392239:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392247:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd7d180/0xefc4487a01859f35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a11 expref: 5991 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392251:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd7d180/0xefc4487a01859f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a11 expref: 5991 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.392256:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073783700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584493760:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.392266:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1328280/0xefc4487a01806b13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a54 expref: 4037 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392270:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1328280/0xefc4487a01806b13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a54 expref: 4037 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.392273:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073786e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584493824:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.392277:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008197a180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.392283:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392284:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392286:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584493696 00000100:00100000:3.0:1705683932.392298:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392298:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.392300:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392300:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920667 00000100:00100000:2.0:1705683932.392301:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392302:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebbc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3191:3081:x1788538584493696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1705683932.392338:0:15223:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.392340:0:15223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.392340:0:15223:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.392341:0:15223:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.392342:0:15223:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.392357:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3192:3081:x1788538584493696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 54us (123us total) trans 4295348190 rc 0/0 00000100:00100000:3.0:1705683932.392360:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920667 00000004:00080000:3.0:1705683932.392372:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebb8000/2, rc 0, transno 380894 00000100:00100000:3.0:1705683932.392375:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009ebb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584493696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.392441:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392442:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392445:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494016 00000100:00100000:3.0:1705683932.392450:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392451:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392452:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920668 00000100:00100000:3.0:1705683932.392454:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e85c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3192:3084:x1788538584494016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.392460:0:15169:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34488 count 1 00010000:00010000:3.0:1705683932.392517:0:15169:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392522:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6e03200/0xefc4487a01806b83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a93 expref: 4037 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392526:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1d32d00/0xefc4487a01859f3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a2d expref: 5991 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392528:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.392528:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.392529:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392537:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1d32d00/0xefc4487a01859f3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a2d expref: 5991 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392543:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1d32d00/0xefc4487a01859f3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a2d expref: 5991 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.392547:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073782800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584494080:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.392559:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6e03200/0xefc4487a01806b83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a93 expref: 4037 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.392562:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6e03200/0xefc4487a01806b83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1a93 expref: 4037 pid: 15170 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.392565:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073786400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584494144:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.392569:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.392576:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392576:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392579:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641012864 00000100:00100000:3.0:1705683932.392587:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392588:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.392590:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413379 00000100:00100000:3.0:1705683932.392591:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e85a800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1791:7329:x1788538641012864:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:3.0:1705683932.392595:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.392596:0:14222:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1705683932.392601:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47980/0xefc4487a01878139 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300df9 expref: 1791 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392606:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:3.0:1705683932.392608:0:14222:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.392611:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a0187850d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f8f expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.392650:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.392654:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392657:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.392667:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133632300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584492992:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1705683932.392671:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8d41:0x0] 00010000:00010000:3.0:1705683932.392736:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187851b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3fe1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.392739:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187851b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392741:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187851b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.392750:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133634600 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584494208:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1705683932.392762:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.392773:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 161 seconds 00010000:00010000:3.0:1705683932.392951:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.392955:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392958:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00010000:3.0:1705683932.392975:0:14222:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1705683932.392976:0:14222:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb mtime from disk: 0 -> 1705683932 00000004:00010000:3.0:1705683932.392977:0:14222:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb atime from disk: 0 -> 1705683932 00000004:00010000:3.0:1705683932.392978:0:14222:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb ctime from disk: 0 -> 1705683932 00000004:00010000:3.0:1705683932.392979:0:14222:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1705683932.392980:0:14222:0:(mdt_io.c:1336:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1705683932.392982:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392984:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392986:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392988:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392990:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6c000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.392991:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392993:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392996:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:3.0:1705683932.392997:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.392998:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.392999:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6c000/0xefc4487a01878514 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00000004:00010000:3.0:1705683932.393003:0:14222:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88009e85a800 reply state ffff88008e4d0000 transno 4295084945 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187851b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.393006:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6f700/0xefc4487a0187851b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x3fe1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.393009:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x3031 (ffff8800875ff800) 00010000:00010000:3.0:1705683932.393010:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.393023:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6de00/0xefc4487a0187850d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f8f expref: 1793 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.393028:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f8f expref: 1792 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.393031:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438f:0x0].0x0 (ffff88009afd8500) 00010000:00010000:3.0:1705683932.393032:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1705683932.393033:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d46a80, rc 0) 00000100:00100000:3.0:1705683932.393053:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e85a800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1793:7329:x1788538641012864:12345-192.168.203.41@tcp:101:touch.0 Request processed in 461us (579us total) trans 4295084945 rc 0/0 00000100:00100000:3.0:1705683932.393056:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413379 00000100:00100000:3.0:1705683932.393547:0:15187:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:15187:1788538584492416:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.393883:0:15187:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:15187:1788538584492544:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.393894:0:15187:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.393897:0:15187:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.393898:0:15187:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.393898:0:15187:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.393973:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.393974:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.393978:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920670 00000100:00100000:3.0:1705683932.393980:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3531:6496:x1788538641012928:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.393985:0:15189:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1705683932.393986:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.393987:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.394184:0:15189:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d46080/0xefc4487a01878530 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300f96 expref: -99 pid: 15189 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.394191:0:15189:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.394197:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.394197:0:15189:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.394200:0:15189:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d46080/0xefc4487a01878530 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f96 expref: 3532 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394205:0:15189:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d46080/0xefc4487a01878530 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f96 expref: 3532 pid: 15189 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394208:0:15189:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d46080, rc 0) 00000100:00100000:3.0:1705683932.394217:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3532:6496:x1788538641012928:12345-192.168.203.41@tcp:101:dd.0 Request processed in 237us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.394220:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920670 00000100:00100000:3.0:1705683932.394404:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394404:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394408:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641013056 00000100:00100000:3.0:1705683932.394417:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394418:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394420:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413380 00000100:00100000:3.0:1705683932.394422:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980b8500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1793:7284:x1788538641013056:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:3.0:1705683932.394426:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.394457:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46d00/0xefc4487a0187853e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300fa4 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394486:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.394492:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394495:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394554:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.394556:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394559:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394580:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.394583:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394585:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394594:0:14236:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+3193:10725:x1788538584493440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3182us (3208us total) trans 4295348191 rc 0/0 00000100:00100000:2.0:1705683932.394597:0:14236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920661 00000100:00100000:3.0:1705683932.394603:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073780a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584493440:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1705683932.394607:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x99f1:0x0]-[0x2c0000402:0x9d01:0x0] 00000004:00200000:3.0:1705683932.394619:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41f0:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.394620:0:14222:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.394626:0:14222:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394629:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394632:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394634:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394636:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394637:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d44500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.394638:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394639:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394640:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.394640:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394643:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff88009afd8a00) 00000100:00100000:2.0:1705683932.394644:0:14418:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641013440 00010000:00010000:3.0:1705683932.394644:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.394645:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394647:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44500/0xefc4487a01878545 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394652:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394653:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394653:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.394654:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394655:0:14418:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641014528 00010000:00010000:3.0:1705683932.394656:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394658:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d44280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.394659:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394660:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394661:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.394661:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394663:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413381 00010000:00010000:3.0:1705683932.394663:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x30 (ffff88009afd8000) 00010000:00010000:3.0:1705683932.394664:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.394664:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394665:0:14418:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800980bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7295:x1788538641013440:12345-192.168.203.41@tcp:36:mrename.0 00010000:00010000:3.0:1705683932.394666:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44280/0xefc4487a01878553 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:2.0:1705683932.394679:0:14418:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.394681:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46d00/0xefc4487a0187853e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fa4 expref: 1797 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.394687:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880084bc9680/0xefc4487a0186d4f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdfb5 expref: 1920 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394687:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fa4 expref: 1796 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394689:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f0:0x0].0x0 (ffff88009e842a00) 00010000:00010000:3.0:1705683932.394690:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.394690:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d45180, rc 0) 00010000:00010000:2.0:1705683932.394695:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11f:0x0].0x0 (ffff880097f3af00) 00010000:00010000:2.0:1705683932.394697:0:14418:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.394701:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980b8500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1796:7284:x1788538641013056:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 278us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.394704:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413380 00000100:00100000:3.0:1705683932.394723:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394723:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394726:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413382 00000100:00100000:3.0:1705683932.394727:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1793:7265:x1788538641014528:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:3.0:1705683932.394733:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.394736:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44780/0xefc4487a01878561 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300fb2 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394762:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.394766:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394769:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:2.0:1705683932.394771:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5f200/0xefc4487a0187856f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:2.0:1705683932.394776:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5f200/0xefc4487a0187856f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 00010000:00010000:2.0:1705683932.394779:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5f200/0xefc4487a0187856f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 00000100:00100000:2.0:1705683932.394798:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494336:0@lo:1000:mdt00_024.0 00000100:00100000:2.0:1705683932.394814:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.394821:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.394823:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.394825:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394827:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394828:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.394828:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394831:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494336 00000100:00100000:2.0:1705683932.394842:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394843:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394845:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59876 00010000:00010000:3.0:1705683932.394845:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:2.0:1705683932.394847:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14418:x1788538584494336:12345-0@lo:1000:mdt00_024.0 00010000:00010000:3.0:1705683932.394849:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394851:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00200000:3.0:1705683932.394860:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4172:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.394861:0:14222:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.394865:0:14222:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394868:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394870:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394872:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394874:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394875:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d47480 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.394876:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394877:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14418:x1788538584494336:12345-0@lo:1000:mdt00_024.0 Request processed in 30us (62us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.394878:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394880:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59876 00010000:00010000:3.0:1705683932.394881:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:3.0:1705683932.394881:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.394882:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394884:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d47480/0xefc4487a01878568 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394888:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394890:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394892:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00000100:00100000:2.0:1705683932.394894:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494336:0@lo:1000:mdt00_024.0 00010000:00010000:3.0:1705683932.394894:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d46800 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.394895:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394897:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394899:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3631 (ffff88009afd8c00) 00010000:00010000:3.0:1705683932.394900:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.394900:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.394902:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46800/0xefc4487a01878576 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00000004:00080000:2.0:1705683932.394907:0:14418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1705683932.394916:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d44780/0xefc4487a01878561 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fb2 expref: 1794 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.394918:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494400:0@lo:1000:mdt00_024.0 00010000:00010000:3.0:1705683932.394921:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fb2 expref: 1793 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394923:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00010000:00010000:3.0:1705683932.394924:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.394924:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d45400, rc 0) 00000100:00100000:3.0:1705683932.394935:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1793:7265:x1788538641014528:12345-192.168.203.41@tcp:101:rm.0 Request processed in 207us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.394938:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413382 00000100:00100000:2.0:1705683932.394954:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.394954:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073786e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584493824:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.394960:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.394961:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073782800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584494080:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.394964:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.394964:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073786400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584494144:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.394965:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394968:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494400 00010000:00010000:3.0:1705683932.394974:0:15169:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.394975:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394976:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00100000:3.0:1705683932.394977:0:15169:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394978:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59877 00010000:00100000:3.0:1705683932.394978:0:15169:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.394978:0:15169:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:2.0:1705683932.394979:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133633200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14418:x1788538584494400:12345-0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.394985:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584493504:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.394992:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d6e580/0xefc4487a018784ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f81 expref: 3447 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.394997:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6e580, rc 0) 00000100:00100000:3.0:1705683932.395004:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebbd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3447:16415:x1788538641012672:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 3439us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.395007:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920662 00000100:00100000:2.0:1705683932.395034:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133633200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14418:x1788538584494400:12345-0@lo:1000:mdt00_024.0 Request processed in 53us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.395037:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59877 00000100:00100000:3.0:1705683932.395042:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494400:0@lo:1000:mdt00_024.0 00000100:00100000:2.0:1705683932.395052:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133634600 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584494208:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1705683932.395056:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8d81:0x0] 00010000:00010000:3.0:1705683932.395110:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395113:0:14418:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395117:0:14418:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14418 initiator: MDT0 00000100:00100000:3.0:1705683932.395122:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494528:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1705683932.395135:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395143:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.395148:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395148:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395151:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494528 00000100:00100000:3.0:1705683932.395158:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395159:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395161:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59878 00000100:00100000:3.0:1705683932.395162:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073786400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:14418:x1788538584494528:12345-0@lo:101:mdt00_024.0 00010000:00010000:3.0:1705683932.395166:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1705683932.395186:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584494592:0@lo:5:osp-pre-0-1.0 00010000:00010000:3.0:1705683932.395191:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46580/0xefc4487a0187858b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878584 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.395198:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1705683932.395199:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46580/0xefc4487a0187858b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878584 expref: 37 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.395203:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 161 seconds 00010000:00010000:3.0:1705683932.395204:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46580/0xefc4487a0187858b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878584 expref: 37 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395207:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.395207:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1705683932.395208:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.395208:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d46580, rc 0) 00000100:00100000:2.0:1705683932.395209:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395212:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494592 00000100:00100000:2.0:1705683932.395219:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395219:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395221:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920673 00000100:00100000:3.0:1705683932.395222:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073786400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:14418:x1788538584494528:12345-0@lo:101:mdt00_024.0 Request processed in 59us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.395223:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133631400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+1046:9011:x1788538584494592:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1705683932.395225:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59878 00002000:00080000:2.0:1705683932.395232:0:15095:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 36226 00000100:00100000:3.0:1705683932.395237:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494528:0@lo:101:mdt00_024.0 00010000:00010000:3.0:1705683932.395242:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395246:0:14418:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1705683932.395251:0:14418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1705683932.395258:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d47200/0xefc4487a01878592 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395261:0:14418:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d47200/0xefc4487a01878592 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395263:0:14418:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d47200/0xefc4487a01878592 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14418 initiator: MDT0 00000100:00100000:3.0:1705683932.395268:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494656:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1705683932.395276:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395281:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.395285:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395285:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395287:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494656 00000100:00100000:3.0:1705683932.395293:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395293:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.395294:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1705683932.395295:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59879 00010000:00010000:2.0:1705683932.395296:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.395296:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073782800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:14418:x1788538584494656:12345-0@lo:101:mdt00_024.0 00010000:00010000:2.0:1705683932.395300:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad0280 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.395300:0:8812:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.395301:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395304:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878465 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395310:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878465 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395313:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878465 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395321:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395321:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395322:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.395325:0:8812:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6fc00/0xefc4487a01878599 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878592 expref: -99 pid: 8812 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395331:0:8812:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6fc00/0xefc4487a01878599 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878592 expref: 38 pid: 8812 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395335:0:8812:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6fc00/0xefc4487a01878599 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878592 expref: 38 pid: 8812 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395338:0:8812:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff8800a1345a00) 00010000:00010000:3.0:1705683932.395338:0:8812:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.395339:0:8812:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d6fc00, rc 0) 00000100:00100000:3.0:1705683932.395350:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073782800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:14418:x1788538584494656:12345-0@lo:101:mdt00_024.0 Request processed in 54us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.395353:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59879 00000100:00100000:3.0:1705683932.395366:0:10725:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073782d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584494720:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1705683932.395375:0:10725:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395380:0:10725:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2276c0 going to sleep for 161 seconds 00000100:00100000:3.0:1705683932.395388:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584494656:0@lo:101:mdt00_024.0 00010000:00010000:3.0:1705683932.395391:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d47200/0xefc4487a01878592 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878599 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395394:0:14418:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d47200/0xefc4487a01878592 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878599 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1705683932.395401:0:14418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1705683932.395405:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a018785a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x11f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395409:0:14418:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf14780/0xefc4487a0186d3eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdf84 expref: 1846 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395412:0:14418:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a018785a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.395418:0:14418:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf14780/0xefc4487a0186d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdf84 expref: 1846 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395422:0:14418:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf14780/0xefc4487a0186d3eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x11f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdf84 expref: 1846 pid: 14196 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.395426:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000_UUID:14418:1788538584494784:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.395435:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.395441:0:15187:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395444:0:15187:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395448:0:15187:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395450:0:15187:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395460:0:15187:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.395463:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.395465:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395468:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5ed00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.395469:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395471:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395476:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395478:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d5ed00/0xefc4487a0187846c lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395485:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395486:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395486:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.395489:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395489:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395492:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494720 00000100:00100000:2.0:1705683932.395499:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395499:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395501:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920674 00000100:00100000:2.0:1705683932.395503:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073781e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3195:10725:x1788538584494720:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1705683932.395511:0:15116:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0001: reserve 128 objects in group 0x2c0000402 at 40194 00000100:00100000:3.0:1705683932.395526:0:15187:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800980ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0001-mdtlov_UUID+3195:3081:x1788538584492288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6158us (6189us total) trans 4295348193 rc 0/0 00000100:00100000:3.0:1705683932.395529:0:15187:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920651 00000004:00080000:3.0:1705683932.395542:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6001e00/2, rc 0, transno 380897 00000100:00100000:3.0:1705683932.395545:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6001e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584492288:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.395552:0:15169:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395555:0:15169:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395558:0:15169:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.395565:0:15169:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1705683932.395572:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009025f300/2, rc 0, transno 380896 00000100:00100000:3.0:1705683932.395573:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009025f300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584491904:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.395583:0:15169:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.395586:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.395588:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395591:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6c280 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.395592:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395595:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395599:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395602:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6c280/0xefc4487a01878506 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.395609:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395609:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.395610:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.395636:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e85c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3195:3084:x1788538584494016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3181us (3201us total) trans 4295348194 rc 0/0 00000100:00100000:3.0:1705683932.395639:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920668 00000100:00100000:3.0:1705683932.395649:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e85b200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584494912:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395657:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1705683932.395665:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e85cb00/2, rc 0, transno 380898 00000100:00100000:3.0:1705683932.395668:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e85cb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584494016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395684:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e85ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584494976:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395692:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395698:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1705683932.395700:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073784100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495040:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395706:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395735:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.395738:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a665bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584495104:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395745:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395753:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395754:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395756:0:15187:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584494976 00000100:00100000:3.0:1705683932.395762:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395762:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395763:0:15187:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495040 00000100:00100000:3.0:1705683932.395767:0:15187:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395767:0:15187:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395768:0:15187:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495104 00000100:00100000:2.0:1705683932.395779:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395780:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395783:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920676 00000004:00080000:3.0:1705683932.395784:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e85b200/2, rc 0, transno 380900 00000100:00100000:2.0:1705683932.395785:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6658f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3199:3081:x1788538584494976:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395787:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e85b200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584494912:0@lo:2:osp-syn-1-1.0 00002000:00080000:2.0:1705683932.395791:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34489 count 1 00000100:00100000:3.0:1705683932.395798:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6658a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584495168:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395806:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1705683932.395817:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009025bc00/2, rc 0, transno 380901 00000100:00100000:3.0:1705683932.395819:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009025bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584492160:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395830:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88013713c100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495232:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395836:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.395844:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395845:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395847:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495168 00000100:00100000:3.0:1705683932.395853:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395854:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395855:0:15189:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495232 00000100:00100000:3.0:1705683932.395859:0:15189:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395859:0:15189:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395862:0:15189:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920679 00000100:00100000:3.0:1705683932.395864:0:15189:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a665a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3200:3084:x1788538584495168:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.395869:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1705683932.395873:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880073784100/2, rc 0, transno 380902 00000100:00100000:3.0:1705683932.395875:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073784100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495040:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.395877:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a72300/0xefc4487a01806bbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ab6 expref: 4031 pid: 15163 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.395883:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfbf480/0xefc4487a01859f51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a3b expref: 5987 pid: 15189 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.395885:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1705683932.395887:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.395887:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88013713b700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495296:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.395888:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.395889:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.395895:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.395901:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfbf480/0xefc4487a01859f51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a3b expref: 5987 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.395907:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfbf480/0xefc4487a01859f51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a3b expref: 5987 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1705683932.395914:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584495360:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.395930:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a72300/0xefc4487a01806bbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ab6 expref: 4031 pid: 15163 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1705683932.395935:0:15189:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.395936:0:15189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.395937:0:15189:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.395938:0:15189:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c5:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:2.0:1705683932.395939:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a72300/0xefc4487a01806bbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ab6 expref: 4031 pid: 15163 timeout: 805 lvb_type: 1 00002000:00010000:3.0:1705683932.395939:0:15189:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.395943:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584495424:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.395949:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a900 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.395953:0:15189:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_096:lustre-MDT0001-mdtlov_UUID+3200:3084:x1788538584495168:12345-0@lo:2:osp-syn-1-1.0 Request processed in 88us (146us total) trans 4295348199 rc 0/0 00000100:00100000:2.0:1705683932.395956:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395956:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395956:0:15189:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920679 00000100:00100000:2.0:1705683932.395960:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495296 00000004:00080000:3.0:1705683932.395966:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6658a00/2, rc 0, transno 380903 00000100:00100000:2.0:1705683932.395968:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.395969:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.395969:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6658a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584495168:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.395971:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920681 00000100:00100000:2.0:1705683932.395973:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013713ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3200:3081:x1788538584495296:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395981:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.395983:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88013713d000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584495552:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.395993:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.396005:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396005:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396008:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584495552 00000100:00100000:2.0:1705683932.396015:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396016:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396016:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396017:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920682 00000100:00100000:3.0:1705683932.396017:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396019:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013713b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3202:3084:x1788538584495552:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.396038:0:15148:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34492 count 1 00002000:00010000:2.0:1705683932.396039:0:15215:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.396041:0:15215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.396041:0:15215:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.396042:0:15215:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.396043:0:15215:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.396058:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013713ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3202:3081:x1788538584495296:12345-0@lo:2:osp-syn-1-1.0 Request processed in 85us (163us total) trans 4295348200 rc 0/0 00000100:00100000:2.0:1705683932.396061:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920681 00010000:00010000:3.0:1705683932.396122:0:15148:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396128:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdbb700/0xefc4487a01806c08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b0a expref: 4031 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.396131:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfbd400/0xefc4487a01859f66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a7a expref: 5987 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.396134:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.396134:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.396135:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396146:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfbd400/0xefc4487a01859f66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a7a expref: 5987 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.396150:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfbd400/0xefc4487a01859f66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a7a expref: 5987 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.396154:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800973c1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584495808:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.396163:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.396164:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b132f80/0xefc4487a018784dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396165:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdbb700/0xefc4487a01806c08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b0a expref: 4030 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.396168:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009b132f80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.396168:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdbb700/0xefc4487a01806c08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b0a expref: 4030 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.396169:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b132f80/0xefc4487a018784dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.396171:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800973c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584495872:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.396172:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b132f80/0xefc4487a018784dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.396176:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff880094e89180 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.396177:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b132f80/0xefc4487a018784dc lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.396179:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b132f80/0xefc4487a018784dc lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.396185:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.396186:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.396186:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1705683932.396235:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013713b700/2, rc 0, transno 380904 00000100:00100000:3.0:1705683932.396238:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88013713b700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495296:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1705683932.396242:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6000a00/2, rc 0, transno 380905 00000100:00100000:3.0:1705683932.396243:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6000a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584492864:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396260:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800973c3200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584495936:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396270:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.396524:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073783700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584493760:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.396533:0:15110:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.396537:0:15110:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.396537:0:15110:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.396538:0:15110:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396592:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396592:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.396640:0:15110:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396643:0:15110:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396646:0:15110:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396648:0:15110:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396653:0:15110:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.396656:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.396657:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396660:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d6f480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.396661:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396663:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396672:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396674:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d6f480/0xefc4487a018784f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.396679:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.396680:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.396680:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.396748:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebb9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3205:3084:x1788538584493312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4593us (4613us total) trans 4295348203 rc 0/0 00000100:00100000:3.0:1705683932.396751:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920665 00000004:00080000:3.0:1705683932.396763:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6007300/2, rc 0, transno 380907 00000100:00100000:3.0:1705683932.396765:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6007300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584493312:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396780:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800973c0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496128:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396789:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.396798:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396799:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396801:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584496128 00010000:00010000:2.0:1705683932.396804:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.396805:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b130500/0xefc4487a018784ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.396806:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396807:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396808:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920686 00010000:00010000:2.0:1705683932.396809:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009b130500 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.396810:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b130500/0xefc4487a018784ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.396810:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090131e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3205:3082:x1788538584496128:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.396812:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b130500/0xefc4487a018784ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.396818:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b130500/0xefc4487a018784ff lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.396821:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b130500/0xefc4487a018784ff lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.396827:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.396828:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.396828:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.396844:0:15110:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95c8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.396845:0:15110:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95c8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.396846:0:15110:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95c8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.396847:0:15110:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95c8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.396848:0:15110:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95c8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1705683932.396870:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3207:3081:x1788538584493632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4670us (4696us total) trans 4295348204 rc 0/0 00000100:00100000:2.0:1705683932.396873:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920666 00000100:00100000:3.0:1705683932.396873:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090131e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3207:3082:x1788538584496128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 62us (83us total) trans 4295348205 rc 0/0 00000100:00100000:3.0:1705683932.396876:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920686 00000100:00100000:2.0:1705683932.396880:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396881:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396884:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641014848 00000004:00080000:3.0:1705683932.396887:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebbe900/2, rc 0, transno 380908 00000100:00100000:3.0:1705683932.396890:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009ebbe900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584493632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.396893:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396894:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.396896:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920687 00000004:00080000:3.0:1705683932.396896:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800973c0500/2, rc 0, transno 380909 00000100:00100000:3.0:1705683932.396897:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800973c0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496128:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.396898:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f09900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4029:6496:x1788538641014848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1705683932.396902:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.396916:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1705683932.396919:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090130500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496448:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396927:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1705683932.396929:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584496384:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.396936:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.396945:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.396953:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396953:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.396956:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920688 00000100:00100000:3.0:1705683932.396958:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3207:3084:x1788538584496320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.396963:0:15110:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34494 count 1 00010000:00010000:2.0:1705683932.397163:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5de00/0xefc4487a018785d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300fc0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1705683932.397170:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1705683932.397170:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090130000/2, rc 0, transno 380910 00000100:00100000:3.0:1705683932.397174:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584496384:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.397176:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.397176:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.397179:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5de00/0xefc4487a018785d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fc0 expref: 4030 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397186:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d5de00/0xefc4487a018785d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fc0 expref: 4030 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.397187:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496576:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1705683932.397190:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5de00, rc 0) 00000100:00100000:3.0:1705683932.397199:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.397200:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f09900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4030:6496:x1788538641014848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 300us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.397202:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920687 00000100:00100000:2.0:1705683932.397207:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397208:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397209:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584496576 00010000:00010000:3.0:1705683932.397210:0:15110:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397218:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123d86080/0xefc4487a01806c4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b50 expref: 4029 pid: 15104 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1705683932.397220:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397221:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397222:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920691 00010000:00010000:3.0:1705683932.397222:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd7e080/0xefc4487a01859e2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a96 expref: 5985 pid: 15179 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1705683932.397224:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3208:3082:x1788538584496576:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.397224:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.397225:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.397225:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397233:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd7e080/0xefc4487a01859e2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a96 expref: 5985 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397236:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd7e080/0xefc4487a01859e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8a96 expref: 5985 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.397240:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090132800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584496704:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.397252:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123d86080/0xefc4487a01806c4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b50 expref: 4029 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397256:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123d86080/0xefc4487a01806c4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b50 expref: 4029 pid: 15104 timeout: 805 lvb_type: 1 00002000:00010000:2.0:1705683932.397258:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95ca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1705683932.397259:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95ca:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:3.0:1705683932.397259:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584496832:192.168.203.41@tcp:104: 00002000:00010000:2.0:1705683932.397260:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.397261:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95ca:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1705683932.397261:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95ca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.397266:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008197a180 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.397282:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3209:3082:x1788538584496576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (82us total) trans 4295348207 rc 0/0 00000004:00080000:3.0:1705683932.397284:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090132d00/2, rc 0, transno 380911 00000100:00100000:2.0:1705683932.397285:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920691 00000100:00100000:3.0:1705683932.397287:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090132d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.397298:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.397300:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090136400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584496896:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.397308:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.397318:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397318:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397322:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584496896 00000100:00100000:2.0:1705683932.397329:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397330:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397331:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641015104 00000100:00100000:3.0:1705683932.397333:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.397333:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397336:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397336:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.397336:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920692 00000100:00100000:2.0:1705683932.397339:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920693 00000100:00100000:3.0:1705683932.397339:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090131400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3209:3084:x1788538584496896:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.397341:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5986:16415:x1788538641015104:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1705683932.397344:0:14282:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:3.0:1705683932.397345:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34496 count 1 00010000:00010000:3.0:1705683932.397403:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397408:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123d87200/0xefc4487a01806c78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b96 expref: 4029 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397412:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce77200/0xefc4487a01859f89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ab2 expref: 5986 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397414:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.397415:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.397415:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397423:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce77200/0xefc4487a01859f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ab2 expref: 5986 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397429:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ce77200/0xefc4487a01859f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ab2 expref: 5986 pid: 15170 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.397433:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090135000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584496960:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.397449:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123d87200/0xefc4487a01806c78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b96 expref: 4029 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.397452:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123d87200/0xefc4487a01806c78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1b96 expref: 4029 pid: 15104 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.397455:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584497024:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.397460:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b79c0 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.397478:0:14282:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5ef80/0xefc4487a018785ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300fc7 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397488:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fdbc00/0xefc4487a0181d7ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9536 expref: 4029 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397491:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1705683932.397492:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1705683932.397493:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5ef80/0xefc4487a018785ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fc7 expref: 5987 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397502:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099fdbc00/0xefc4487a0181d7ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9536 expref: 4029 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397505:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099fdbc00/0xefc4487a0181d7ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9536 expref: 4029 pid: 15135 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1705683932.397510:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584497088:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.397524:0:14282:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a480 going to sleep for 11 seconds 00000100:00100000:2.0:1705683932.397529:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397530:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397532:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641015168 00000100:00100000:2.0:1705683932.397542:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397542:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397543:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641015296 00000100:00100000:2.0:1705683932.397548:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397548:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397550:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413383 00000100:00100000:3.0:1705683932.397550:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.397551:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.397552:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0c600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1873:7323:x1788538641015168:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:2.0:1705683932.397556:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.397557:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413384 00000100:00100000:3.0:1705683932.397560:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1794:7329:x1788538641015296:12345-192.168.203.41@tcp:36:touch.0 00010000:00010000:2.0:1705683932.397595:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5fc00/0xefc4487a018785f4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300fce expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397609:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.397616:0:6531:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f8f expref: 1794 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.397621:0:6531:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 4/0,1 mode: --/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.397632:0:6531:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f8f expref: 1794 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397638:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.397638:0:6531:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d46a80/0xefc4487a01878522 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f8f expref: 1794 pid: 14222 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1705683932.397643:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00000100:00100000:3.0:1705683932.397644:0:6531:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1788538584497152:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.397646:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:3.0:1705683932.397662:0:6531:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b73c0 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.397702:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.397705:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397707:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:3.0:1705683932.397726:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073785000 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000_UUID:14418:1788538584494784:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.397735:0:14418:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a018785a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 00010000:00100000:3.0:1705683932.397739:0:14418:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.397739:0:14418:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.397740:0:14418:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.397742:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.397745:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397747:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.397758:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x419f:0x0]: returning size 4096 00000004:00200000:2.0:1705683932.397760:0:14377:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1705683932.397764:0:14377:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397768:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397770:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397772:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397774:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397775:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5e080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.397776:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397778:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397782:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:2.0:1705683932.397783:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.397784:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397786:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878602 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397790:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397792:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397794:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397795:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.397796:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397798:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397800:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff8800a15c5900) 00010000:00010000:2.0:1705683932.397801:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.397801:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397803:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a01878609 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.397819:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5fc00/0xefc4487a018785f4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1875 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397824:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1874 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.397826:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:2.0:1705683932.397827:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1705683932.397827:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998cad00, rc 0) 00000100:00100000:2.0:1705683932.397838:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0c600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1874:7323:x1788538641015168:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 285us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.397840:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584495360:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.397841:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413383 00000100:00100000:3.0:1705683932.397914:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584495424:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.397926:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.397930:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.397930:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.397931:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.398363:0:14418:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a018785a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398368:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6f980/0xefc4487a018785a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x11f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398433:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5fc00/0xefc4487a01878617 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x11f:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398440:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5fc00/0xefc4487a01878617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398445:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5fc00/0xefc4487a01878617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11f:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 00000100:00100000:3.0:1705683932.398467:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497216:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398484:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.398493:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.398506:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800973c1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584495808:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.398518:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398519:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398553:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497216:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398575:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497280:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398588:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.398595:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d227300 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.398605:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398605:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398647:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497280:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398689:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497344:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398702:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.398723:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.398733:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398733:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398763:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497344:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398785:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497408:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398800:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.398807:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d227300 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.398820:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398821:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398851:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497408:0@lo:1000:mdt00_024.0 00000004:00080000:3.0:1705683932.398862:0:14418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000404:0x41d5:0x0] 00000100:00100000:3.0:1705683932.398877:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497472:0@lo:1000:mdt00_024.0 00000100:00100000:3.0:1705683932.398891:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.398899:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.398907:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398908:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.398935:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497472:0@lo:1000:mdt00_024.0 00000004:00080000:3.0:1705683932.398946:0:14418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1705683932.398973:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123f5c000/0xefc4487a0187861e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398977:0:14418:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123f5c000/0xefc4487a0187861e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.398981:0:14418:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123f5c000/0xefc4487a0187861e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14418 initiator: MDT0 00000100:00100000:3.0:1705683932.398988:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497536:0@lo:101:mdt00_024.0 00000100:00100000:3.0:1705683932.399003:0:14418:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.399011:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d2273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.399035:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399035:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399172:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800973c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584495872:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.399186:0:15148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.399190:0:15148:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399191:0:15148:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399192:0:15148:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.399261:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399267:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399271:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399276:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5d180/0xefc4487a018785a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399285:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1705683932.399372:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6658f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3210:3081:x1788538584494976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3585us (3678us total) trans 4295348208 rc 0/0 00000100:00100000:3.0:1705683932.399377:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920676 00000004:00080000:3.0:1705683932.399398:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e85ad00/2, rc 0, transno 380912 00000100:00100000:3.0:1705683932.399402:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e85ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584494976:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.399429:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef9400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584497664:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.399445:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1705683932.399468:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013713c100/2, rc 0, transno 380913 00000100:00100000:3.0:1705683932.399472:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88013713c100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584495232:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.399491:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1705683932.399495:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef9900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584497728:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.399509:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.399523:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399524:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399527:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584497728 00000100:00100000:3.0:1705683932.399538:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399539:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399542:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920695 00000100:00100000:3.0:1705683932.399544:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3211:3082:x1788538584497728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.399553:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34497 count 1 00000100:00100000:2.0:1705683932.399647:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584497088:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.399657:0:14282:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d5ef80/0xefc4487a018785ed lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fc7 expref: 5984 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399663:0:14282:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5ef80, rc 0) 00000100:00100000:2.0:1705683932.399673:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5984:16415:x1788538641015104:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2331us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1705683932.399676:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920693 00010000:00010000:3.0:1705683932.399699:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399706:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013507f200/0xefc4487a01806ca2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bb9 expref: 4026 pid: 15165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.399725:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098486300/0xefc4487a01859fdd lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ac0 expref: 5983 pid: 15118 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.399730:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.399731:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.399732:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399744:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098486300/0xefc4487a01859fdd lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ac0 expref: 5983 pid: 15118 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.399751:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098486300/0xefc4487a01859fdd lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ac0 expref: 5983 pid: 15118 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.399757:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efe400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584497792:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.399774:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013507f200/0xefc4487a01806ca2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bb9 expref: 4026 pid: 15165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.399780:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013507f200/0xefc4487a01806ca2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bb9 expref: 4026 pid: 15165 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.399786:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584497856:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.399794:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d227300 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.399816:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efe900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584497920:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.399829:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.399851:0:6531:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1788538584497152:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.399859:0:6531:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00100000:3.0:1705683932.399863:0:6531:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399864:0:6531:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399864:0:6531:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399876:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090135000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584496960:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.399881:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584497024:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.399890:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.399894:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399895:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399895:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.399907:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090132800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584496704:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.399913:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584496832:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.399920:0:15110:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.399924:0:15110:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399925:0:15110:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.399925:0:15110:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.399931:0:15148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399935:0:15148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399940:0:15148:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399944:0:15148:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.399957:0:15148:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.399960:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.399962:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399966:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5de00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.399967:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399970:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399975:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399978:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123f5de00/0xefc4487a018785bc lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399989:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.399990:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132328280/0xefc4487a018785b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399992:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880132328280 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.399993:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132328280/0xefc4487a018785b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399995:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132328280/0xefc4487a018785b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.399999:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132328280/0xefc4487a018785b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400001:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132328280/0xefc4487a018785b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400005:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.400005:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.400006:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.400007:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.400043:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013713b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3214:3084:x1788538584495552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4022us (4048us total) trans 4295348212 rc 0/0 00000100:00100000:3.0:1705683932.400048:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920682 00000004:00080000:3.0:1705683932.400067:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097efe900/2, rc 0, transno 380915 00000100:00100000:3.0:1705683932.400070:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efe900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584497920:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.400074:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1705683932.400096:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584498112:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.400111:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.400131:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.400132:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400132:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.400133:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400136:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920700 00000100:00100000:2.0:1705683932.400139:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.400139:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400139:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3215:3082:x1788538584498112:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.400141:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920701 00000100:00100000:2.0:1705683932.400143:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3215:3084:x1788538584497984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.400148:0:15148:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34499 count 1 00002000:00080000:2.0:1705683932.400150:0:14282:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34498 count 1 00010000:00010000:3.0:1705683932.400219:0:15148:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400227:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123d87480/0xefc4487a01806cf6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bf8 expref: 4024 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.400232:0:14282:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400232:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe580/0xefc4487a01859f90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ae3 expref: 5981 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400236:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.400237:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013507d180/0xefc4487a01806cd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bd5 expref: 4024 pid: 15165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400237:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.400237:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400241:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c64f00/0xefc4487a01859f97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ace expref: 5981 pid: 15191 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.400244:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.400245:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1705683932.400245:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400249:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe580/0xefc4487a01859f90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ae3 expref: 5981 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.400254:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c64f00/0xefc4487a01859f97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ace expref: 5981 pid: 15191 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400255:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe580/0xefc4487a01859f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ae3 expref: 5981 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1705683932.400258:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c64f00/0xefc4487a01859f97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ace expref: 5980 pid: 15191 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.400262:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584498176:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.400263:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584498240:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.400276:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013507d180/0xefc4487a01806cd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bd5 expref: 4024 pid: 15165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1705683932.400280:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013507d180/0xefc4487a01806cd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bd5 expref: 4024 pid: 15165 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.400283:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123d87480/0xefc4487a01806cf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bf8 expref: 4024 pid: 15147 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1705683932.400286:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d5a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584498368:192.168.203.41@tcp:104: 00000100:00100000:2.0:1705683932.400290:0:14282:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a480 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.400293:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123d87480/0xefc4487a01806cf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1bf8 expref: 4025 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.400299:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584498432:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.400308:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008197a180 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.400340:0:15110:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400345:0:15110:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400349:0:15110:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400353:0:15110:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400367:0:15110:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.400370:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.400371:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400374:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5ed00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.400375:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400378:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400383:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400385:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123f5ed00/0xefc4487a018785df lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.400393:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.400394:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.400394:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.400488:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3218:3084:x1788538584496320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3529us (3566us total) trans 4295348216 rc 0/0 00000100:00100000:3.0:1705683932.400493:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920688 00000004:00080000:3.0:1705683932.400510:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090133c00/2, rc 0, transno 380920 00000100:00100000:3.0:1705683932.400515:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090133c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584496320:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.400561:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584498752:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.400578:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.400595:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400596:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400599:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584498752 00000100:00100000:3.0:1705683932.400608:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400609:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400612:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920705 00000100:00100000:3.0:1705683932.400614:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3218:3084:x1788538584498752:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.400622:0:15135:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34501 count 1 00010000:00010000:3.0:1705683932.400696:0:15135:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400704:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66d0780/0xefc4487a01806d3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c37 expref: 4021 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400722:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebb1900/0xefc4487a01859fa5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8aff expref: 5980 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400726:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.400727:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.400728:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400741:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebb1900/0xefc4487a01859fa5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8aff expref: 5979 pid: 15170 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.400746:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebb1900/0xefc4487a01859fa5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8aff expref: 5979 pid: 15170 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.400758:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584498816:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.400766:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400770:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400774:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.400778:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5db80/0xefc4487a018785e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.400779:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133631400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+1047:9011:x1788538584494592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 5555us (5580us total) trans 4295340566 rc 0/0 00000100:00100000:2.0:1705683932.400782:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920673 00010000:00010000:3.0:1705683932.400786:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1705683932.400798:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133637300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584494592:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1705683932.400803:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8af0:0x0]-[0x280000402:0x8dc1:0x0] 00000004:00080000:3.0:1705683932.400859:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090130500/2, rc 0, transno 380921 00000100:00100000:3.0:1705683932.400870:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090130500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584496448:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.400879:0:6531:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.400883:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.400924:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af1:0x0], index 0: 0 00000004:00010000:3.0:1705683932.400924:0:6531:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1705683932.400926:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f2:0x0], index 1: 0 00000004:00010000:3.0:1705683932.400926:0:6531:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb mtime from disk: 1705683932 -> 1705683933 00000004:00080000:2.0:1705683932.400928:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af2:0x0], index 0: 0 00000004:00010000:3.0:1705683932.400928:0:6531:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb atime from disk: 1705683932 -> 1705683933 00000004:00010000:3.0:1705683932.400929:0:6531:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb ctime from disk: 1705683932 -> 1705683933 00000004:00080000:2.0:1705683932.400930:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f3:0x0], index 1: 0 00000004:00010000:3.0:1705683932.400931:0:6531:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000402:0x438f:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1705683932.400932:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400934:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f4:0x0], index 1: 0 00000004:00010000:3.0:1705683932.400934:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880099f08f00 reply state ffff880099be5000 transno 4295084947 ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.400935:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400937:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400939:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400940:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f6:0x0], index 1: 0 00010000:00010000:3.0:1705683932.400940:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5c780/0xefc4487a018785fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x438f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.400941:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400943:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400945:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af7:0x0], index 0: 0 00010000:00010000:3.0:1705683932.400945:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x438f:0x0].0x0 (ffff88009afd8500) 00010000:00010000:3.0:1705683932.400946:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1705683932.400947:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400948:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400950:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99f9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400952:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8af9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400953:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99fa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400955:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8afa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400956:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99fb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400958:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8afb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400959:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99fc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400961:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8afc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400962:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99fd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400964:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8afd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400966:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99fe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400967:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8afe:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400970:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x99ff:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400971:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8aff:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400971:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1796:7329:x1788538641015296:12345-192.168.203.41@tcp:36:touch.0 Request processed in 3410us (3588us total) trans 4295084947 rc 0/0 00000004:00080000:2.0:1705683932.400973:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a00:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400974:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b00:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400974:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413384 00000004:00080000:2.0:1705683932.400976:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a01:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400977:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b01:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400979:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a02:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400980:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b02:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400981:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.400982:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a03:0x0], index 1: 0 00000100:00100000:3.0:1705683932.400982:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.400983:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b03:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400984:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641016832 00000004:00080000:2.0:1705683932.400985:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a04:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400986:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b04:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400988:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a05:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400990:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b05:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400991:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.400992:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a06:0x0], index 1: 0 00000100:00100000:3.0:1705683932.400992:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.400993:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b06:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400993:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641017024 00000004:00080000:2.0:1705683932.400994:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a07:0x0], index 1: 0 00000004:00080000:2.0:1705683932.400996:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b07:0x0], index 0: 0 00000004:00080000:2.0:1705683932.400998:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a08:0x0], index 1: 0 00000100:00100000:3.0:1705683932.400998:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.400998:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.400999:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b08:0x0], index 0: 0 00000100:00100000:3.0:1705683932.400999:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641017152 00000004:00080000:2.0:1705683932.401001:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a09:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401003:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b09:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401003:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.401004:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.401005:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0a:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401005:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413385 00000004:00080000:2.0:1705683932.401007:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0a:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401007:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880081878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1874:7323:x1788538641016832:12345-192.168.203.41@tcp:101:mkdir.0 00000004:00080000:2.0:1705683932.401008:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401010:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0b:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401011:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1705683932.401012:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401014:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0c:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401015:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5e580/0xefc4487a01878664 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f300ff1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401017:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401019:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401022:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401024:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401026:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a0f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401029:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b0f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401031:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a10:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401034:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b10:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401036:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a11:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401038:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b11:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401041:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a12:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401044:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b12:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401046:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a13:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401048:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b13:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401050:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401051:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a14:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401053:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b14:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401054:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401055:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a15:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401057:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401058:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b15:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401060:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a16:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401063:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b16:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401065:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a17:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401068:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b17:0x0], index 0: 0 00000004:00200000:3.0:1705683932.401068:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4154:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.401069:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:2.0:1705683932.401071:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a18:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401073:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b18:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401075:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a19:0x0], index 1: 0 00000004:00010000:3.0:1705683932.401089:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401100:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b19:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401103:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5e580/0xefc4487a01878664 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ff1 expref: 1876 pid: 6531 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401104:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401106:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401109:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1b:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401109:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ff1 expref: 1875 pid: 6531 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401111:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1b:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401112:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4154:0x0].0x0 (ffff8801363a4900) 00010000:00010000:3.0:1705683932.401113:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00080000:2.0:1705683932.401114:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1c:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401114:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123f5f200, rc 0) 00000004:00080000:2.0:1705683932.401116:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401119:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401121:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1d:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401122:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880081878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1875:7323:x1788538641016832:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 114us (290us total) trans 0 rc 0/0 00000004:00080000:2.0:1705683932.401123:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401124:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1e:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401125:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413385 00000004:00080000:2.0:1705683932.401126:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a1f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401127:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b1f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401128:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a20:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401130:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b20:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401130:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.401130:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.401131:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a21:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401132:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641016896 00000004:00080000:2.0:1705683932.401133:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b21:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401134:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a22:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401136:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b22:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401138:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a23:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401139:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b23:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401139:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.401139:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.401141:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a24:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401141:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413386 00000004:00080000:2.0:1705683932.401143:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b24:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401143:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1921:7185:x1788538641017024:12345-192.168.203.41@tcp:36:rm.0 00000004:00080000:2.0:1705683932.401144:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a25:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401146:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b25:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401148:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a26:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401149:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b26:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401150:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a27:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401151:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b27:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401153:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a28:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401154:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b28:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401155:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a29:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401155:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000004:00080000:2.0:1705683932.401157:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b29:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401158:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401160:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401161:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2b:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401161:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d6c780/0xefc4487a0187839a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x438c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f26 expref: 1921 pid: 14377 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401163:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401165:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401166:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401168:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2d:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401168:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135290f00/0xefc4487a0180d818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x438c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d50cc expref: 1920 pid: 14198 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401169:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401170:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401172:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401173:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a2f:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401173:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800984f3800) 00000004:00080000:2.0:1705683932.401175:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b2f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401177:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a30:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401178:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b30:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401180:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a31:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401180:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8a1b80/0xefc4487a01877c31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c94 expref: 1919 pid: 14222 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401181:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b31:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401182:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a32:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401184:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b32:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401184:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00000004:00080000:2.0:1705683932.401185:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a33:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401185:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1705683932.401187:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b33:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401188:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a34:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401190:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b34:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401191:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a35:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401193:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b35:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401194:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a36:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401194:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401196:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b36:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401197:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a37:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401197:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401199:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b37:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401199:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401200:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a38:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401202:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b38:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401204:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a39:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401206:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b39:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401207:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401209:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401211:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401212:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401214:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401216:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401217:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401219:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401221:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401222:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401224:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a3f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401225:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b3f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401227:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a40:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401228:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b40:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401230:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a41:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401232:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b41:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401233:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a42:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401235:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a43:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401237:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a44:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401238:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a45:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401240:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a46:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401241:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a47:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401243:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a48:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401244:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a49:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401245:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401247:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401248:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401250:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401252:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401254:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a4f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401255:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a50:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401257:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a51:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401259:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a52:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401260:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a53:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401262:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a54:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401263:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a55:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401265:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a56:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401267:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a57:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401268:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a58:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401270:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a59:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401271:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5e800/0xefc4487a01878687 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x40bb:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401272:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401273:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5b:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401273:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5e800/0xefc4487a01878687 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401274:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5c:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401275:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5e800/0xefc4487a01878687 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401276:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401277:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401279:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a5f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401280:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a60:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401282:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a61:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401283:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a62:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401285:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a63:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401287:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a64:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401288:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a65:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401290:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a66:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401292:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a67:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401294:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a68:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401295:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a69:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401297:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401298:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401300:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401301:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401303:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401304:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a6f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401306:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a70:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401307:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a71:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401309:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a72:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401310:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a73:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401312:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a74:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401314:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a75:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401315:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a76:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401317:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a77:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401319:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a78:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401320:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a79:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401322:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401323:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401324:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401326:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401327:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401329:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a7f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401331:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a80:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401333:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a81:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401335:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a82:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401336:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b42:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401338:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a83:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401340:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b43:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401343:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a84:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401346:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b44:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401348:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a85:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401351:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b45:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401353:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a86:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401353:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401356:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b46:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401356:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401359:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a87:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401359:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401361:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b47:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401363:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a88:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401366:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b48:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401368:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a89:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401371:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b49:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401374:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401377:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401380:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401383:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401385:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401388:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401390:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401393:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401395:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401396:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401398:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a8f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401399:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b4f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401401:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a90:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401402:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b50:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401404:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a91:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401406:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b51:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401407:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a92:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401408:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b52:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401410:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a93:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401411:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b53:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401412:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a94:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401414:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b54:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401415:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a95:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401417:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b55:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401418:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a96:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401419:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b56:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401421:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a97:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401422:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b57:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401424:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a98:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401425:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b58:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401426:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a99:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401428:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b59:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401430:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401431:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401433:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401434:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401435:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401437:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401438:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401439:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401441:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401442:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5e:0x0], index 0: 0 00000004:00200000:3.0:1705683932.401443:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000402:0x438c:0x0]: returning size 4096 00000004:00080000:2.0:1705683932.401444:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9a9f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401445:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b5f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401447:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401448:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b60:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401448:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401449:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401450:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b61:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401451:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401452:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401453:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b62:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401453:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401455:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa3:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401455:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5c500 already unused, calling callback (ffffffffa0d756d0) 00000004:00080000:2.0:1705683932.401456:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b63:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401456:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401457:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa4:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401458:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401459:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b64:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401460:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa5:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401461:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x438c:0x0].0x0 (ffff8800a1345000) 00000004:00080000:2.0:1705683932.401462:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b65:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401462:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.401462:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401463:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa6:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401464:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a0187868e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x438c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401465:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b66:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401467:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401468:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b67:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401470:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401472:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b68:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401473:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aa9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401474:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b69:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401475:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aaa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401477:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401479:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aab:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401480:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6b:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401480:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401481:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aac:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401483:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6c:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401483:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401484:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aad:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401485:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401487:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aae:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401487:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401488:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6e:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401489:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401490:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aaf:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401490:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5cc80 already unused, calling callback (ffffffffa0d756d0) 00000004:00080000:2.0:1705683932.401491:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b6f:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401491:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401493:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab0:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401493:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401494:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b70:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401495:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab1:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401495:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:3.0:1705683932.401495:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.401496:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 3/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401497:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b71:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401498:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab2:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401498:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5cc80/0xefc4487a01878680 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401500:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b72:0x0], index 0: 0 00000004:00010000:3.0:1705683932.401500:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88008187df00 reply state ffff88009a680000 transno 4295091436 ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5e800/0xefc4487a01878687 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401502:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401503:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b73:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401503:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5e800/0xefc4487a01878687 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x40bb:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401505:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab4:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401505:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x39 (ffff8800a1345500) 00010000:00010000:3.0:1705683932.401506:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1705683932.401507:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b74:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401508:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401510:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b75:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401511:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401512:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b76:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401513:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401515:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b77:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401516:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401518:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b78:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401519:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ab9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401521:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b79:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401522:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aba:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401522:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7185:x1788538641017024:12345-192.168.203.41@tcp:36:rm.0 Request processed in 378us (677us total) trans 4295091436 rc 0/0 00000004:00080000:2.0:1705683932.401523:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401525:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9abb:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401525:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413386 00000004:00080000:2.0:1705683932.401526:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401528:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9abc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401529:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401530:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9abd:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401530:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.401531:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.401532:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7d:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401533:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413387 00000004:00080000:2.0:1705683932.401534:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9abe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401535:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7e:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401535:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1797:7265:x1788538641017152:12345-192.168.203.41@tcp:36:rm.0 00000004:00080000:2.0:1705683932.401536:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9abf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401538:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b7f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401540:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401541:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b80:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401542:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401544:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b81:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401545:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401546:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b82:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401546:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000004:00080000:2.0:1705683932.401548:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401549:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b83:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401550:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac4:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401551:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45400/0xefc4487a0187857d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fb2 expref: 1797 pid: 14222 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401552:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b84:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401553:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401555:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b85:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401556:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401557:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b86:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401558:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac7:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401558:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d6ca00/0xefc4487a01878362 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x4172:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300f03 expref: 1796 pid: 14377 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401560:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b87:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401561:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac8:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401562:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00000004:00080000:2.0:1705683932.401563:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b88:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401564:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ac9:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401565:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01877c69 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ca2 expref: 1795 pid: 8825 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401566:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b89:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401567:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aca:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401568:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401570:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9acb:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401570:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00000004:00080000:2.0:1705683932.401571:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8b:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401571:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1705683932.401572:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9acc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401574:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401576:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9acd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401577:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8d:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401577:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401579:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ace:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401580:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8e:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401580:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401581:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9acf:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401582:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401583:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b8f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401584:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401585:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b90:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401587:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401589:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b91:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401590:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401591:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b92:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401593:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401595:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b93:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401596:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401597:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b94:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401599:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401601:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b95:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401602:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401604:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b96:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401605:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401606:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b97:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401608:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401609:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b98:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401611:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ad9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401613:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b99:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401614:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ada:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401616:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401618:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9adb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401619:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401621:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9adc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401623:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401624:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9add:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401626:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401627:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ade:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401629:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401630:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9adf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401632:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8b9f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401634:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401635:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401637:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401638:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401640:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401641:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401642:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae3:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401643:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d680/0xefc4487a018786aa lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42b2:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401644:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401645:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae4:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401645:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d680/0xefc4487a018786aa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401647:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401648:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae5:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401649:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d680/0xefc4487a018786aa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401650:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401652:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401653:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401655:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401657:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401658:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401660:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401661:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ae9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401663:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ba9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401664:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aea:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401666:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8baa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401667:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aeb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401669:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bab:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401669:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.401670:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aec:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401672:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bac:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401672:0:6531:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800737c5400/0xefc4487a01857e0a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f704f expref: 1876 pid: 6532 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401673:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aed:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401675:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bad:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401675:0:6531:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.401676:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aee:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401678:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bae:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401679:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aef:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401681:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8baf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401682:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401683:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb0:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401683:0:6531:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800737c5400/0xefc4487a01857e0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f704f expref: 1876 pid: 6532 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401685:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401686:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb1:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401686:0:6531:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800737c5400/0xefc4487a01857e0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4172:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f704f expref: 1876 pid: 6532 timeout: 805 lvb_type: 0 00000004:00080000:2.0:1705683932.401688:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401689:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401691:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af3:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401691:0:6531:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1788538584499456:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.401692:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401694:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401695:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401697:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401698:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401700:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401702:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401703:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af7:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401703:0:6531:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b79c0 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.401704:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401706:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401707:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401722:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9af9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401723:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bb9:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401723:0:14202:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.401724:0:14202:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.401725:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9afa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401727:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bba:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401728:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9afb:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401728:0:14202:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413389 00000004:00080000:2.0:1705683932.401730:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bbb:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401730:0:14202:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8095850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1794:7331:x1788538641017344:12345-192.168.203.41@tcp:101:lfs.0 00000004:00080000:2.0:1705683932.401731:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9afc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401733:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bbc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401734:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9afd:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401735:0:14202:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1705683932.401736:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bbd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401737:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9afe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401739:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bbe:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401741:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9aff:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401742:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bbf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401744:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b00:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401745:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401747:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b01:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401748:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401749:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b02:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401751:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401753:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b03:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401755:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401756:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b04:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401757:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401759:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b05:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401761:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc5:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401761:0:14202:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5c500/0xefc4487a018786bf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301006 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401762:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b06:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401764:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401765:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b07:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401767:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401769:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b08:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401770:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401772:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b09:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401774:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bc9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401775:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401778:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bca:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401779:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401781:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bcb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401782:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401784:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bcc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401786:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401787:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bcd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401789:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401790:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bce:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401792:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b0f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401793:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bcf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401795:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b10:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401796:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401797:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b11:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401799:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401801:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b12:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401802:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401804:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b13:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401805:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401806:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b14:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401808:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401809:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b15:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401811:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401812:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b16:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401814:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd6:0x0], index 0: 0 00000004:00200000:3.0:1705683932.401814:0:14202:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41d5:0x0]: returning size 4096 00000004:00080000:2.0:1705683932.401815:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b17:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401817:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401818:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b18:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401820:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401821:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b19:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401823:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bd9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401825:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401826:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bda:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401828:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401829:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bdb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401831:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401832:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bdc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401833:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401835:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bdd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401837:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401839:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bde:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401840:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b1f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401842:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bdf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401843:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b20:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401845:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401846:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b21:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401848:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401849:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b22:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401850:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be2:0x0], index 0: 0 00010000:00010000:3.0:1705683932.401851:0:14202:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5c500/0xefc4487a018786bf lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301006 expref: 1796 pid: 14202 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401852:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b23:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401853:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401855:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b24:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401855:0:14202:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5c500/0xefc4487a018786bf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301006 expref: 1796 pid: 14202 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.401857:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401859:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b25:0x0], index 1: 0 00010000:00010000:3.0:1705683932.401859:0:14202:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5c500, rc 0) 00000004:00080000:2.0:1705683932.401861:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401862:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b26:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401864:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401865:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b27:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401867:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401868:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b28:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401869:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be8:0x0], index 0: 0 00000100:00100000:3.0:1705683932.401869:0:14202:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8095850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1795:7331:x1788538641017344:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 138us (602us total) trans 4295084948 rc 301/301 00000004:00080000:2.0:1705683932.401871:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b29:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401872:0:14202:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413389 00000004:00080000:2.0:1705683932.401873:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8be9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401875:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401876:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bea:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401878:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401879:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8beb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401881:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401883:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bec:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401884:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401886:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bed:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401887:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401889:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bee:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401890:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b2f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401892:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bef:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401893:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b30:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401895:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401896:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b31:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401898:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401899:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b32:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401901:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401903:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b33:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401904:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401905:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b34:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401907:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401908:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b35:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401910:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401912:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b36:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401913:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401915:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b37:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401917:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401918:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b38:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401919:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401921:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b39:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401922:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bf9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401924:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401925:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bfa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401927:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401928:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bfb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401930:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401932:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bfc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401933:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401935:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bfd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401937:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401938:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bfe:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401940:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b3f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401941:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8bff:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401943:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b40:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401944:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c00:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401945:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b41:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401947:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c01:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401948:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b42:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401950:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c02:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401951:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b43:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401953:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c03:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401954:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b44:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401956:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c04:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401958:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b45:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401959:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c05:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401960:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b46:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401962:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c06:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401963:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b47:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401965:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c07:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401966:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b48:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401968:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c08:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401969:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b49:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401971:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c09:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401973:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401975:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401976:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401978:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401979:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401981:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401982:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4d:0x0], index 1: 0 00000100:00100000:3.0:1705683932.401982:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efe400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584497792:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.401984:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401986:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401987:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401988:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b4f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401990:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c0f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401992:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b50:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401993:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c10:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401994:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b51:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401996:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c11:0x0], index 0: 0 00000004:00080000:2.0:1705683932.401998:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b52:0x0], index 1: 0 00000004:00080000:2.0:1705683932.401999:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c12:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402001:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b53:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402002:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c13:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402003:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090131400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3222:3084:x1788538584496896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4664us (4694us total) trans 4295348218 rc 0/0 00000004:00080000:2.0:1705683932.402004:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b54:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402005:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c14:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402006:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b55:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402006:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920692 00000004:00080000:2.0:1705683932.402008:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c15:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402009:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b56:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402011:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c16:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402011:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.402011:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402013:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b57:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402013:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584499392 00000004:00080000:2.0:1705683932.402014:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c17:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402015:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b58:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402017:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c18:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402018:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b59:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402019:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.402019:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402020:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c19:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402021:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5a:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402021:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920711 00000004:00080000:2.0:1705683932.402023:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1a:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402023:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135572800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3222:3084:x1788538584499392:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.402024:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402026:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402027:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402028:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1c:0x0], index 0: 0 00002000:00080000:3.0:1705683932.402028:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34503 count 1 00000004:00080000:2.0:1705683932.402030:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402031:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402033:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402035:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402036:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b5f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402038:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c1f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402039:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b60:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402041:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c20:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402042:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b61:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402044:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c21:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402046:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b62:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402048:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c22:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402049:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b63:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402051:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c23:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402052:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b64:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402054:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c24:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402056:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b65:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402057:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c25:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402058:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b66:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402060:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c26:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402061:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b67:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402062:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c27:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402064:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b68:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402065:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c28:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402067:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b69:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402068:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c29:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402070:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402071:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402072:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402074:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402075:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402089:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402092:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402094:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402096:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402097:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402099:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b6f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402100:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c2f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402102:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b70:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402103:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402104:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c30:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402105:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b71:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402107:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c31:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402108:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b72:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402109:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c32:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402109:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4022 pid: 14405 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.402111:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b73:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402112:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c33:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402112:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.402114:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b74:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402115:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c34:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402115:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.402116:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.402117:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b75:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402117:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402118:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c35:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402120:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b76:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402121:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c36:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402123:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b77:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402124:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c37:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402125:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.402126:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b78:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402127:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c38:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402128:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 805 lvb_type: 1 00000004:00080000:2.0:1705683932.402129:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b79:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402130:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c39:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402132:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7a:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402132:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584499584:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402134:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402135:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402136:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402138:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402140:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402141:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402143:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402144:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7e:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402145:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4022 pid: 14405 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.402146:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402147:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b7f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402148:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c3f:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402149:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4022 pid: 14405 timeout: 805 lvb_type: 1 00000004:00080000:2.0:1705683932.402150:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b80:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402151:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c40:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402152:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584499648:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402153:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b81:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402154:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c41:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402156:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b82:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402156:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012b274840 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.402157:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c42:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402158:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b83:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402160:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c43:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402161:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b84:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402162:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c44:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402164:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b85:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402165:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c45:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402167:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b86:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402168:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c46:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402170:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b87:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402171:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c47:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402173:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b88:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402173:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66d0780/0xefc4487a01806d3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c37 expref: 4022 pid: 15147 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.402174:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c48:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402176:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b89:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402176:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a66d0780/0xefc4487a01806d3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c37 expref: 4022 pid: 15147 timeout: 805 lvb_type: 1 00000004:00080000:2.0:1705683932.402178:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c49:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402179:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8a:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402180:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584499712:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402181:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402182:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402183:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4b:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402184:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff880094e89180 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.402185:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402186:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402187:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402189:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402190:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402192:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402193:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b8f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402195:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c4f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402196:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b90:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402198:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c50:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402200:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b91:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402202:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c51:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402203:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b92:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402204:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c52:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402206:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b93:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402207:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c53:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402209:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b94:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402211:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c54:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402212:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b95:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402214:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c55:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402216:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b96:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402217:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c56:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402219:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b97:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402220:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c57:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402222:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b98:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402223:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c58:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402225:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b99:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402226:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c59:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402227:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402229:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402230:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402232:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402233:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402235:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402236:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402238:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402239:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402241:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402242:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9b9f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402244:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c5f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402245:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402247:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c60:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402248:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402250:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c61:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402251:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402253:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c62:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402254:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402256:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c63:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402257:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402259:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c64:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402260:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402261:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c65:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402263:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402265:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c66:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402266:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba7:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402266:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402267:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c67:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402267:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402269:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402270:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c68:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402270:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584499776 00000004:00080000:2.0:1705683932.402272:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ba9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402273:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c69:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402275:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9baa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402276:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402277:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bab:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402279:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402280:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bac:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402282:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402283:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bad:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402285:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402287:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bae:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402288:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402290:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9baf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402291:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c6f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402293:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb0:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402293:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-mdtlov_UUID:14418:1788538584497536:0@lo:101:mdt00_024.0 00000004:00080000:2.0:1705683932.402294:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c70:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402296:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402297:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c71:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402298:0:14418:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123f5c000/0xefc4487a0187861e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878625 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402299:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402300:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c72:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402301:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb3:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402301:0:14418:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880123f5c000/0xefc4487a0187861e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878625 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402302:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c73:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402303:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402305:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c74:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402306:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402308:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c75:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402310:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb6:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402310:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584497856:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402311:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c76:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402312:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402314:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c77:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402315:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402317:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c78:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402317:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402318:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bb9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402320:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c79:0x0], index 0: 0 00010000:00100000:3.0:1705683932.402320:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.402320:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.402321:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402322:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bba:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402324:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402325:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bbb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402327:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402329:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bbc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402330:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402332:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bbd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402333:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7d:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402334:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.402334:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402335:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bbe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402336:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7e:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402336:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641017408 00000004:00080000:2.0:1705683932.402337:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bbf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402339:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c7f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402340:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402342:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c80:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402342:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.402342:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402343:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402345:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c81:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402345:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641017472 00000004:00080000:2.0:1705683932.402346:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402348:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c82:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402349:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc3:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402349:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402350:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c83:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402350:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402352:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc4:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402352:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920714 00000004:00080000:2.0:1705683932.402354:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c84:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402354:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135572d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4023:6496:x1788538641017408:12345-192.168.203.41@tcp:101:dd.0 00000004:00080000:2.0:1705683932.402355:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402357:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c85:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402357:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1705683932.402359:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402361:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c86:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402362:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402364:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c87:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402366:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402367:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c88:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402368:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bc9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402370:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c89:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402371:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bca:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402372:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402374:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bcb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402375:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402377:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bcc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402378:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402380:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bcd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402381:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402383:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bce:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402384:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402386:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bcf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402387:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c8f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402389:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402390:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c90:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402392:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402394:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c91:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402395:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402397:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c92:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402399:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402401:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c93:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402402:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402404:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c94:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402406:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402407:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c95:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402409:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402410:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c96:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402412:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402413:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c97:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402416:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402417:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c98:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402419:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bd9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402420:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c99:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402421:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bda:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402423:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402424:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bdb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402426:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402427:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bdc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402428:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402430:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bdd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402431:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402433:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bde:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402434:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402436:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bdf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402438:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8c9f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402440:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402441:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402442:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402444:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402445:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402447:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402448:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402450:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402451:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402453:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402454:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402456:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402457:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402459:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402460:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402462:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402463:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402465:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402466:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9be9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402468:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ca9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402469:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bea:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402471:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8caa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402472:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9beb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402473:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cab:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402475:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bec:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402477:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cac:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402477:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584498176:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402479:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bed:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402480:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cad:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402481:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584498432:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.402482:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bee:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402483:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cae:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402485:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bef:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402486:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8caf:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402487:0:15148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402488:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402489:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb0:0x0], index 0: 0 00010000:00100000:3.0:1705683932.402490:0:15148:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.402490:0:15148:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.402490:0:15148:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402491:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402493:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402494:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf2:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402494:0:15131:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.402494:0:15131:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.402496:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402497:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf3:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402497:0:15131:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920715 00000004:00080000:2.0:1705683932.402499:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb3:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402499:0:15131:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135571900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3450:6521:x1788538641017472:12345-192.168.203.41@tcp:101:dd.0 00000004:00080000:2.0:1705683932.402501:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402502:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb4:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402502:0:15131:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1705683932.402503:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402505:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402506:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402508:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402510:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402511:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402512:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402514:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402515:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bf9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402517:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cb9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402518:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bfa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402520:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cba:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402521:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bfb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402523:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cbb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402525:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bfc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402526:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cbc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402527:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bfd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402529:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cbd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402530:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bfe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402532:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cbe:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402533:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9bff:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402534:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cbf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402536:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c00:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402538:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402539:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c01:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402541:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402542:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c02:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402543:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402545:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c03:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402547:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402548:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c04:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402550:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402551:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c05:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402553:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402555:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c06:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402556:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402558:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c07:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402559:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402561:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c08:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402562:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402564:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c09:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402565:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cc9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402567:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402568:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cca:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402569:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402571:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ccb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402572:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402573:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ccc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402574:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402576:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ccd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402577:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402579:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cce:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402581:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c0f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402582:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ccf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402584:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c10:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402585:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402587:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c11:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402589:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402590:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c12:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402592:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402594:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c13:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402595:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402597:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c14:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402598:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402599:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c15:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402601:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402602:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c16:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402604:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402605:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c17:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402607:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402608:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c18:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402610:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402611:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c19:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402613:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cd9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402614:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402615:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cda:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402617:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402618:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cdb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402619:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402621:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cdc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402622:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402624:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cdd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402626:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402627:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cde:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402628:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c1f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402630:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cdf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402631:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c20:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402632:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402634:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c21:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402636:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402637:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c22:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402638:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402640:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c23:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402641:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402643:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c24:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402644:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402646:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c25:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402647:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402649:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c26:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402650:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402651:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c27:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402653:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402654:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c28:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402655:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402657:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c29:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402658:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ce9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402660:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402661:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cea:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402663:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402665:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ceb:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402667:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402668:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cec:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402669:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402671:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8ced:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402672:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402674:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cee:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402674:0:15131:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098264280/0xefc4487a018786e9 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301014 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402675:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c2f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402676:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cef:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402678:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c30:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402679:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402680:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c31:0x0], index 1: 0 00002000:00010000:3.0:1705683932.402680:0:15131:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1705683932.402682:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402683:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c32:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402684:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402686:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c33:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402686:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.402686:0:15131:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.402687:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402688:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c34:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402688:0:15131:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098264280/0xefc4487a018786e9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301014 expref: 3451 pid: 15131 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402690:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402691:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c35:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402692:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf5:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402693:0:15131:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098264280/0xefc4487a018786e9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301014 expref: 3451 pid: 15131 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402694:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c36:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402696:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf6:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402696:0:15131:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098264280, rc 0) 00000004:00080000:2.0:1705683932.402697:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c37:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402699:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402701:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c38:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402702:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402704:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c39:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402705:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cf9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402706:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3a:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402707:0:15131:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135571900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_050:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3451:6521:x1788538641017472:12345-192.168.203.41@tcp:101:dd.0 Request processed in 208us (367us total) trans 0 rc 0/0 00000004:00080000:2.0:1705683932.402716:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cfa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402719:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402721:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cfb:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402722:0:15131:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920715 00000004:00080000:2.0:1705683932.402723:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402724:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cfc:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402725:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402727:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cfd:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402728:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402730:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cfe:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402731:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c3f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402733:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8cff:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402733:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098266d00/0xefc4487a018786f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9205:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30100d expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402734:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c40:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402736:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d00:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402737:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c41:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402738:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d01:0x0], index 0: 0 00002000:00010000:3.0:1705683932.402739:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9205:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1705683932.402740:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c42:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402742:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d02:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402743:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c43:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402743:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.402744:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.402745:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d03:0x0], index 0: 0 00010000:00010000:3.0:1705683932.402745:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098266d00/0xefc4487a018786f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30100d expref: 4023 pid: 15169 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402747:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c44:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402748:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d04:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402749:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c45:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402749:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098266d00/0xefc4487a018786f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30100d expref: 4023 pid: 15169 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.402751:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d05:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402752:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c46:0x0], index 1: 0 00010000:00010000:3.0:1705683932.402752:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098266d00, rc 0) 00000004:00080000:2.0:1705683932.402753:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d06:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402755:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c47:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402756:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d07:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402758:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c48:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402759:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d08:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402760:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c49:0x0], index 1: 0 00000100:00100000:3.0:1705683932.402761:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135572d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4023:6496:x1788538641017408:12345-192.168.203.41@tcp:101:dd.0 Request processed in 407us (439us total) trans 0 rc 0/0 00000004:00080000:2.0:1705683932.402762:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d09:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402763:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402764:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0a:0x0], index 0: 0 00000100:00100000:3.0:1705683932.402764:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920714 00000004:00080000:2.0:1705683932.402766:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402768:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402769:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402770:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402771:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402773:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402774:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402775:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402776:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c4f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402778:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d0f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402780:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c50:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402781:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d10:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402783:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c51:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402784:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d11:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402786:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c52:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402787:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d12:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402789:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c53:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402790:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d13:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402792:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c54:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402793:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d14:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402795:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c55:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402796:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d15:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402798:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c56:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402799:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d16:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402800:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c57:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402802:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d17:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402803:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c58:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402804:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d18:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402806:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c59:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402807:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d19:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402808:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402809:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402811:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402812:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402814:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402816:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402817:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402819:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402820:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402822:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402823:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c5f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402824:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d1f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402825:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c60:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402827:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d20:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402828:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c61:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402830:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d21:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402831:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c62:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402832:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d22:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402833:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c63:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402835:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d23:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402836:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c64:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402837:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d24:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402839:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c65:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402841:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d25:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402842:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c66:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402843:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d26:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402845:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c67:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402846:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d27:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402848:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c68:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402849:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d28:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402851:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c69:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402853:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d29:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402854:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402856:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402857:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402859:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402860:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402861:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402862:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402864:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402865:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402866:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402868:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c6f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402869:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d2f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402870:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c70:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402871:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d30:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402873:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c71:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402874:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d31:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402876:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c72:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402877:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d32:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402878:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c73:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402880:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d33:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402881:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c74:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402882:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d34:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402884:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c75:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402886:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d35:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402887:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c76:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402889:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d36:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402890:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c77:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402891:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d37:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402893:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c78:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402894:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d38:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402895:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c79:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402896:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d39:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402898:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402899:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402901:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402902:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402903:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402905:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402906:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402907:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402909:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402910:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402912:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c7f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402913:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d3f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402914:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c80:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402916:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d40:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402917:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c81:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402918:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d41:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402920:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c82:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402921:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d42:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402923:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c83:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402924:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d43:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402925:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c84:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402927:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d44:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402928:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c85:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402930:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d45:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402931:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c86:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402932:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d46:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402934:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c87:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402935:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d47:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402936:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c88:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402938:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d48:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402939:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c89:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402940:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d49:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402942:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402943:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402945:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402946:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402948:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402949:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402951:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402952:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402953:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402955:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402957:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c8f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402958:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d4f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402960:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c90:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402961:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d50:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402962:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c91:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402964:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d51:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402965:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c92:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402967:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d52:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402968:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c93:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402969:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d53:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402971:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c94:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402972:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d54:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402973:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c95:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402975:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d55:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402976:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c96:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402977:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d56:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402979:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c97:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402980:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d57:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402982:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c98:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402983:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d58:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402985:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c99:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402986:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d59:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402988:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9a:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402989:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402991:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9b:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402992:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402994:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9c:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402995:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402996:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9d:0x0], index 1: 0 00000004:00080000:2.0:1705683932.402998:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.402999:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9e:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403000:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403002:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9c9f:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403003:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d5f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403005:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403006:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d60:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403008:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403009:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d61:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403010:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403012:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d62:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403013:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403015:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d63:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403016:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403017:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d64:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403019:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403020:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d65:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403021:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403023:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d66:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403024:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403026:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d67:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403027:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403029:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d68:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403031:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ca9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403033:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d69:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403034:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9caa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403035:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403036:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cab:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403038:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403039:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cac:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403040:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403042:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cad:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403043:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403045:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cae:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403047:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403048:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9caf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403050:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d6f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403051:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403053:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d70:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403054:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403056:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d71:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403057:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403059:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d72:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403060:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403062:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d73:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403063:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403065:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d74:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403066:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403068:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d75:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403069:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403070:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d76:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403072:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403073:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d77:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403074:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403076:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d78:0x0], index 0: 0 00010000:00010000:2.0:1705683932.403095:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.403097:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013232af80/0xefc4487a018785c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403100:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013232af80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.403101:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232af80/0xefc4487a018785c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403104:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232af80/0xefc4487a018785c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403110:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013232af80/0xefc4487a018785c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403113:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013232af80/0xefc4487a018785c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403122:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.403123:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.403123:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1705683932.403140:0:9011:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584499968:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1705683932.403152:0:9011:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1705683932.403164:0:9011:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d33a300 going to sleep for 161 seconds 00000100:00100000:3.0:1705683932.403175:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.403176:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584498240:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.403176:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.403178:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584499968 00000100:00100000:2.0:1705683932.403180:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d5a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584498368:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.403186:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.403186:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.403188:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920716 00000100:00100000:3.0:1705683932.403189:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+1047:9011:x1788538584499968:12345-0@lo:5:osp-pre-0-1.0 00010000:00010000:2.0:1705683932.403190:0:14282:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00100000:2.0:1705683932.403193:0:14282:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.403194:0:14282:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:2.0:1705683932.403194:0:14282:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.403198:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cb9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403202:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d79:0x0], index 0: 0 00002000:00080000:3.0:1705683932.403203:0:15169:0:(ofd_dev.c:1656:ofd_create_hdl()) lustre-OST0000: reserve 64 objects in group 0x280000402 at 36290 00000004:00080000:2.0:1705683932.403204:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cba:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403205:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403207:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cbb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403209:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403210:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cbc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403212:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403213:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cbd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403214:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403216:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cbe:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403218:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403219:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cbf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403221:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d7f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403222:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403224:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d80:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403225:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403226:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d81:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403228:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403229:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d82:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403231:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403232:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d83:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403233:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403235:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d84:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403236:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403238:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d85:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403239:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403240:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d86:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403242:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403243:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d87:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403244:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403246:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d88:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403247:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cc9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403248:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d89:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403250:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cca:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403251:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403253:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ccb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403254:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403256:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ccc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403258:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403259:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ccd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403260:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403262:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cce:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403263:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403264:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ccf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403265:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d8f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403267:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403268:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d90:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403270:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403271:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d91:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403272:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403274:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d92:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403275:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403276:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d93:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403277:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403279:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d94:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403280:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403281:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d95:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403283:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403284:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d96:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403285:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403287:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d97:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403288:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403290:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d98:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403291:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cd9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403293:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d99:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403294:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cda:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403295:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9a:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403297:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cdb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403298:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9b:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403299:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cdc:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403301:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9c:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403302:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cdd:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403304:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9d:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403305:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cde:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403306:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9e:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403308:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cdf:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403309:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8d9f:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403310:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403311:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403312:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403314:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403315:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403317:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403318:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403319:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403321:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403322:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403324:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403325:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403326:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403328:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403329:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403330:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403331:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403333:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403334:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ce9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403335:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8da9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403336:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cea:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403338:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8daa:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403339:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ceb:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403340:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dab:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403342:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cec:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403343:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dac:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403344:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9ced:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403346:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dad:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403347:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cee:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403348:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dae:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403349:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cef:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403351:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8daf:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403352:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf0:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403354:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db0:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403355:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf1:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403357:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db1:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403358:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf2:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403360:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db2:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403361:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf3:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403362:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db3:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403363:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf4:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403364:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db4:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403366:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf5:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403367:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db5:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403369:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf6:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403370:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db6:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403371:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf7:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403373:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db7:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403374:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf8:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403375:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db8:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403377:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cf9:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403378:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8db9:0x0], index 0: 0 00000004:00080000:2.0:1705683932.403380:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cfa:0x0], index 1: 0 00000004:00080000:2.0:1705683932.403381:0:14255:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dba:0x0], index 0: 0 00000100:00100000:3.0:1705683932.403433:0:6531:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1788538584499456:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.403439:0:6531:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00100000:3.0:1705683932.403442:0:6531:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.403443:0:6531:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.403443:0:6531:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000040:00080000:2.0:1705683932.403759:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1051, 88 off75544 00000004:00080000:2.0:1705683932.403762:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465694653ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403776:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5008, 88 off357784 00000004:00080000:2.0:1705683932.403777:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465709687ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403783:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1052, 88 off75632 00000004:00080000:2.0:1705683932.403784:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465716332ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403788:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5009, 88 off357872 00000004:00080000:2.0:1705683932.403789:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465721489ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403793:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1053, 88 off75720 00000004:00080000:2.0:1705683932.403794:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465726519ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403798:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5010, 88 off357960 00000004:00080000:2.0:1705683932.403799:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465731229ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403802:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1054, 88 off75808 00000004:00080000:2.0:1705683932.403803:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465735824ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403807:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5011, 88 off358048 00000004:00080000:2.0:1705683932.403809:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465740914ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403812:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1055, 88 off75896 00000004:00080000:2.0:1705683932.403814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465746162ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.403817:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000040:00080000:2.0:1705683932.403818:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5012, 88 off358136 00000004:00080000:2.0:1705683932.403819:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465750912ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.403819:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.403822:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1056, 88 off75984 00010000:00010000:3.0:1705683932.403822:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998cb700 already unused, calling callback (ffffffffa0664e00) 00000004:00080000:2.0:1705683932.403823:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465755538ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.403823:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.403826:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.403827:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5013, 88 off358224 00000004:00080000:2.0:1705683932.403828:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465760094ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403831:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1057, 88 off76072 00010000:00010000:3.0:1705683932.403831:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.403832:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465764485ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.403834:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800998cb700/0xefc4487a01878648 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.403836:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5014, 88 off358312 00000004:00080000:2.0:1705683932.403837:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465769077ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403840:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1058, 88 off76160 00000004:00080000:2.0:1705683932.403841:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465773478ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.403841:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.403842:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.403842:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.403845:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5015, 88 off358400 00000004:00080000:2.0:1705683932.403846:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465777902ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403849:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1059, 88 off76248 00000004:00080000:2.0:1705683932.403850:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465782702ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403854:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5016, 88 off358488 00000004:00080000:2.0:1705683932.403855:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465787205ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403858:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1060, 88 off76336 00000004:00080000:2.0:1705683932.403860:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465792044ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403863:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5017, 88 off358576 00000004:00080000:2.0:1705683932.403865:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465796927ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403868:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1061, 88 off76424 00000004:00080000:2.0:1705683932.403869:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465801518ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403873:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5018, 88 off358664 00000004:00080000:2.0:1705683932.403874:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465806007ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.403877:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1062, 88 off76512 00000004:00080000:2.0:1705683932.403878:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705465810544ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.403882:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5019, 88 off358752 00000004:00080000:2.0:1705683932.403883:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705465815103ns, next at 706174782226ns, rc = 0 00000100:00100000:2.0:1705683932.403887:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.403888:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.403891:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641018816 00000100:00100000:2.0:1705683932.403900:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.403900:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.403903:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413390 00000100:00100000:2.0:1705683932.403905:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1877:16427:x1788538641018816:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1705683932.403909:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.403910:0:14377:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1705683932.403916:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5f200/0xefc4487a0187866b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4154:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ff1 expref: 1877 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403924:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4154:0x0].0x0 (ffff8801363a4900) 00010000:00010000:2.0:1705683932.403926:0:14377:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1705683932.403930:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9400/0xefc4487a018786fe lrc: 2/0,0 mode: --/CW res: [0x240000404:0x4154:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301022 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.403976:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.403980:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.403983:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404010:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.404012:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404015:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404034:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caa80/0xefc4487a01878713 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4155:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.404037:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caa80/0xefc4487a01878713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4155:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404039:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caa80/0xefc4487a01878713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4155:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:2.0:1705683932.404042:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4155:0x0]: returning size 5 00010000:00010000:2.0:1705683932.404064:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404066:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404069:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404070:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404072:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998ca300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.404073:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404075:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404093:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4154:0x0].0x0 (ffff8801363a4900) 00010000:00010000:2.0:1705683932.404094:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.404095:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404097:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca300/0xefc4487a01878705 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x4154:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404102:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404104:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404106:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404110:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800998c9680 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:2.0:1705683932.404111:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404113:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404115:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4154:0x0].0x3731 (ffff8800a15c5c00) 00010000:00010000:2.0:1705683932.404115:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1705683932.404116:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404118:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9680/0xefc4487a0187870c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4154:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:2.0:1705683932.404135:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998c9400/0xefc4487a018786fe lrc: 0/0,0 mode: --/CW res: [0x240000404:0x4154:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301022 expref: 1879 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404139:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caa80/0xefc4487a01878713 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4155:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301022 expref: 1878 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404141:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4155:0x0].0x0 (ffff88011d9b7400) 00010000:00010000:2.0:1705683932.404142:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1705683932.404143:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800998caa80, rc 0) 00000100:00100000:2.0:1705683932.404157:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1878:16427:x1788538641018816:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 251us (934us total) trans 4295084950 rc 0/0 00000100:00100000:2.0:1705683932.404160:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413390 00000040:00080000:2.0:1705683932.404179:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1063, 88 off76600 00000004:00080000:2.0:1705683932.404181:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466113633ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404190:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5020, 88 off358840 00000004:00080000:2.0:1705683932.404192:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466124197ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404198:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1064, 88 off76688 00000004:00080000:2.0:1705683932.404199:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466131628ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404204:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5021, 88 off358928 00000004:00080000:2.0:1705683932.404205:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466137665ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404211:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1065, 88 off76776 00000004:00080000:2.0:1705683932.404212:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466144658ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404217:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5022, 88 off359016 00000004:00080000:2.0:1705683932.404218:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466150437ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404222:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1066, 88 off76864 00000004:00080000:2.0:1705683932.404223:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466154994ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404227:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5023, 88 off359104 00000004:00080000:2.0:1705683932.404228:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466159937ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404232:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1067, 88 off76952 00000004:00080000:2.0:1705683932.404233:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466164867ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404236:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5024, 88 off359192 00000004:00080000:2.0:1705683932.404237:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466169527ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404241:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1068, 88 off77040 00000004:00080000:2.0:1705683932.404242:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466174038ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404245:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5025, 88 off359280 00000004:00080000:2.0:1705683932.404246:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466178535ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404250:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1069, 88 off77128 00000004:00080000:2.0:1705683932.404251:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466182972ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404256:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5026, 88 off359368 00000004:00080000:2.0:1705683932.404257:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466189364ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404262:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1070, 88 off77216 00000004:00080000:2.0:1705683932.404263:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466195447ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404268:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5027, 88 off359456 00000004:00080000:2.0:1705683932.404269:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466201158ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404272:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1071, 88 off77304 00000004:00080000:2.0:1705683932.404274:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466205845ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404277:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5028, 88 off359544 00000004:00080000:2.0:1705683932.404278:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466210548ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404282:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1072, 88 off77392 00000004:00080000:2.0:1705683932.404283:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466215077ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404286:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5029, 88 off359632 00000004:00080000:2.0:1705683932.404287:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466219607ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404291:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1073, 88 off77480 00000004:00080000:2.0:1705683932.404292:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466224204ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404295:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5030, 88 off359720 00000004:00080000:2.0:1705683932.404296:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466228712ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404300:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1074, 88 off77568 00000004:00080000:2.0:1705683932.404301:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466233248ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404304:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5031, 88 off359808 00000004:00080000:2.0:1705683932.404305:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466237754ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404309:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1075, 88 off77656 00000004:00080000:2.0:1705683932.404310:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466242358ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404314:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5032, 88 off359896 00000004:00080000:2.0:1705683932.404315:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466247153ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404318:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1076, 88 off77744 00000004:00080000:2.0:1705683932.404319:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466251665ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404323:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5033, 88 off359984 00000004:00080000:2.0:1705683932.404324:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466256273ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404353:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1077, 88 off77832 00000004:00080000:2.0:1705683932.404355:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466287007ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404369:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5034, 88 off360072 00000004:00080000:2.0:1705683932.404371:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466303235ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404379:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1078, 88 off77920 00000004:00080000:2.0:1705683932.404381:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466313058ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404386:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5035, 88 off360160 00000004:00080000:2.0:1705683932.404387:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466319258ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404392:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1079, 88 off78008 00000004:00080000:2.0:1705683932.404393:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466325594ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404398:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5036, 88 off360248 00000004:00080000:2.0:1705683932.404399:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466331344ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404403:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1080, 88 off78096 00000004:00080000:2.0:1705683932.404405:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466337079ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404409:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5037, 88 off360336 00000004:00080000:2.0:1705683932.404410:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466342298ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404413:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1081, 88 off78184 00000004:00080000:2.0:1705683932.404414:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466346799ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404418:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5038, 88 off360424 00000004:00080000:2.0:1705683932.404419:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466351404ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404422:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1082, 88 off78272 00000004:00080000:2.0:1705683932.404423:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466355744ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404448:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5040, 88 off360536 00000004:00080000:2.0:1705683932.404450:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466382717ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404456:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1083, 88 off78360 00000004:00080000:2.0:1705683932.404457:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466389454ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404461:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5041, 88 off360624 00000004:00080000:2.0:1705683932.404462:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466394575ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404466:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1084, 88 off78448 00000004:00080000:2.0:1705683932.404467:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466399245ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404470:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5042, 88 off360712 00000004:00080000:2.0:1705683932.404472:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466403945ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404481:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1085, 88 off78536 00000004:00080000:2.0:1705683932.404483:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466415158ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404490:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5043, 88 off360800 00000004:00080000:2.0:1705683932.404492:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466423962ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404499:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1086, 88 off78624 00000004:00080000:2.0:1705683932.404500:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466432673ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404508:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5044, 88 off360888 00000004:00080000:2.0:1705683932.404509:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466441575ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404514:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1087, 88 off78712 00000004:00080000:2.0:1705683932.404515:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466447695ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404520:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5045, 88 off360976 00000004:00080000:2.0:1705683932.404522:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466453900ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404526:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1088, 88 off78800 00000004:00080000:2.0:1705683932.404527:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466459263ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404530:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5046, 88 off361064 00000004:00080000:2.0:1705683932.404532:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466463882ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404535:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1089, 88 off78888 00000004:00080000:2.0:1705683932.404536:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466468753ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404540:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5047, 88 off361152 00000004:00080000:2.0:1705683932.404541:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466473415ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404545:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1090, 88 off78976 00000004:00080000:2.0:1705683932.404546:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466478107ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404549:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5048, 88 off361240 00000004:00080000:2.0:1705683932.404550:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466482690ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404554:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1091, 88 off79064 00000004:00080000:2.0:1705683932.404555:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466487107ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404558:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5049, 88 off361328 00000004:00080000:2.0:1705683932.404559:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466491555ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404563:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1092, 88 off79152 00000004:00080000:2.0:1705683932.404564:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466495938ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404567:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5050, 88 off361416 00000004:00080000:2.0:1705683932.404568:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466500372ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404571:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1093, 88 off79240 00000004:00080000:2.0:1705683932.404573:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466504920ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404576:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5051, 88 off361504 00000004:00080000:2.0:1705683932.404577:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466509395ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404580:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1094, 88 off79328 00000004:00080000:2.0:1705683932.404581:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466513792ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404585:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5052, 88 off361592 00000004:00080000:2.0:1705683932.404586:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466518222ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404589:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1095, 88 off79416 00000004:00080000:2.0:1705683932.404590:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466522590ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404594:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5053, 88 off361680 00000004:00080000:2.0:1705683932.404595:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466527047ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404598:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1096, 88 off79504 00000004:00080000:2.0:1705683932.404599:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466531453ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404603:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5054, 88 off361768 00000004:00080000:2.0:1705683932.404603:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466535825ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.404606:0:6531:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404607:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1097, 88 off79592 00000004:00080000:2.0:1705683932.404608:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466540407ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.404609:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404611:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5055, 88 off361856 00000004:00080000:2.0:1705683932.404612:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466544800ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404616:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1098, 88 off79680 00000004:00080000:2.0:1705683932.404617:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466549115ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404620:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5056, 88 off361944 00000004:00080000:2.0:1705683932.404621:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466553485ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404625:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1099, 88 off79768 00000004:00080000:2.0:1705683932.404625:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466557803ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404629:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5057, 88 off362032 00000004:00080000:2.0:1705683932.404630:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466562210ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404633:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1100, 88 off79856 00000004:00080000:2.0:1705683932.404634:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466566572ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404643:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5058, 88 off362120 00000004:00080000:2.0:1705683932.404645:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466577270ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404652:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1101, 88 off79944 00000004:00080000:2.0:1705683932.404654:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466586195ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404661:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5059, 88 off362208 00000004:00080000:2.0:1705683932.404663:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466594865ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404668:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1102, 88 off80032 00000004:00080000:2.0:1705683932.404669:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466601120ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404673:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5060, 88 off362296 00000004:00080000:2.0:1705683932.404674:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466606540ns, next at 706174782226ns, rc = 0 00000004:00200000:3.0:1705683932.404676:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4172:0x0]: returning size 4096 00000040:00080000:2.0:1705683932.404678:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1103, 88 off80120 00000004:00080000:2.0:1705683932.404679:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466611575ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.404681:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404684:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404686:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5061, 88 off362384 00010000:00010000:3.0:1705683932.404687:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.404688:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466620248ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.404688:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5d900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.404689:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404691:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404694:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4172:0x0].0x0 (ffff880131c86700) 00000040:00080000:2.0:1705683932.404696:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1104, 88 off80208 00010000:00010000:3.0:1705683932.404696:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.404696:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.404697:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466629725ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.404698:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d900/0xefc4487a018786b1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x4172:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404702:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5062, 88 off362472 00000004:00080000:2.0:1705683932.404703:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466635637ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404717:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1105, 88 off80296 00000004:00080000:2.0:1705683932.404719:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466651275ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404725:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5063, 88 off362560 00000004:00080000:2.0:1705683932.404726:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466658265ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404736:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1106, 88 off80384 00000004:00080000:2.0:1705683932.404738:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466670142ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404743:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5064, 88 off362648 00000004:00080000:2.0:1705683932.404744:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466676700ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404752:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1107, 88 off80472 00000004:00080000:2.0:1705683932.404754:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466686015ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.404758:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404761:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5065, 88 off362736 00010000:00010000:3.0:1705683932.404761:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.404762:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466694728ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.404763:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404767:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1108, 88 off80560 00010000:00010000:3.0:1705683932.404767:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000004:00080000:2.0:1705683932.404768:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466700745ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.404769:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cad2300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.404770:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404772:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404773:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5066, 88 off362824 00000004:00080000:2.0:1705683932.404774:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466706827ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.404775:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:3.0:1705683932.404776:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.404777:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404778:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad2300/0xefc4487a0187869c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404779:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1109, 88 off80648 00000004:00080000:2.0:1705683932.404780:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466712555ns, next at 706187302248ns, rc = 0 00000004:00010000:3.0:1705683932.404783:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88008187cb00 reply state ffff88008488c000 transno 4295084951 ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d680/0xefc4487a018786aa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000040:00080000:2.0:1705683932.404784:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5067, 88 off362912 00000004:00080000:2.0:1705683932.404785:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466717410ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.404786:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5d680/0xefc4487a018786aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x42b2:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.404788:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3631 (ffff8800a1345200) 00000040:00080000:2.0:1705683932.404789:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1110, 88 off80736 00010000:00010000:3.0:1705683932.404789:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1705683932.404790:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466722035ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404793:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5068, 88 off363000 00000004:00080000:2.0:1705683932.404794:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466726812ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404798:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1111, 88 off80824 00000004:00080000:2.0:1705683932.404799:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466731270ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.404804:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1796:7265:x1788538641017152:12345-192.168.203.41@tcp:36:rm.0 Request processed in 3267us (3946us total) trans 4295084951 rc 0/0 00000100:00100000:3.0:1705683932.404807:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413387 00010000:00010000:2.0:1705683932.404808:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.404810:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404813:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5d900 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.404814:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404817:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404823:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404826:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123f5d900/0xefc4487a0187862c lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.404833:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.404834:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.404834:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.404839:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5069, 88 off363088 00000004:00080000:2.0:1705683932.404841:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466773187ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404845:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1112, 88 off80912 00000004:00080000:2.0:1705683932.404846:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466778787ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404850:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5070, 88 off363176 00000004:00080000:2.0:1705683932.404852:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466783962ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404855:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1113, 88 off81000 00000004:00080000:2.0:1705683932.404856:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466788737ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404860:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5071, 88 off363264 00000004:00080000:2.0:1705683932.404861:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466793495ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404865:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1114, 88 off81088 00000004:00080000:2.0:1705683932.404866:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466798013ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404869:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5072, 88 off363352 00000004:00080000:2.0:1705683932.404870:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466802423ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404874:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1115, 88 off81176 00000004:00080000:2.0:1705683932.404875:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466806985ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404878:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5073, 88 off363440 00000100:00100000:3.0:1705683932.404890:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+1048:9011:x1788538584499968:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1699us (1738us total) trans 4295340567 rc 0/0 00000100:00100000:2.0:1705683932.404895:0:9011:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9011:1788538584499968:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1705683932.404896:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920716 00000004:00080000:2.0:1705683932.404899:0:9011:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000402:0x8dba:0x0]-[0x280000402:0x8e01:0x0] 00000004:00080000:2.0:1705683932.404903:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466835370ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404911:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1116, 88 off81264 00000004:00080000:2.0:1705683932.404912:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466844683ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404923:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5074, 88 off363528 00000004:00080000:2.0:1705683932.404924:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466856202ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.404926:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.404926:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.404929:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584500544 00000040:00080000:2.0:1705683932.404930:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1117, 88 off81352 00000004:00080000:2.0:1705683932.404931:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466863548ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.404936:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.404937:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.404939:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5075, 88 off363616 00000100:00100000:3.0:1705683932.404939:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920720 00000004:00080000:2.0:1705683932.404941:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466872962ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.404941:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3227:3082:x1788538584500544:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.404947:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34506 count 1 00000040:00080000:2.0:1705683932.404948:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1118, 88 off81440 00000004:00080000:2.0:1705683932.404950:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466882278ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404955:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5076, 88 off363704 00000004:00080000:2.0:1705683932.404956:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466888793ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404962:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1119, 88 off81528 00000004:00080000:2.0:1705683932.404963:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466895107ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404972:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5077, 88 off363792 00000004:00080000:2.0:1705683932.404973:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466905430ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404979:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1120, 88 off81616 00000004:00080000:2.0:1705683932.404980:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466912275ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.404987:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5078, 88 off363880 00000004:00080000:2.0:1705683932.404989:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466920955ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.404996:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1121, 88 off81704 00000004:00080000:2.0:1705683932.404998:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466930375ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405003:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5079, 88 off363968 00000004:00080000:2.0:1705683932.405004:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466936802ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405010:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1122, 88 off81792 00000004:00080000:2.0:1705683932.405011:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466943193ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405015:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5080, 88 off364056 00000004:00080000:2.0:1705683932.405016:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466948047ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405016:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405019:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1123, 88 off81880 00000004:00080000:2.0:1705683932.405020:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466952750ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405022:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354ade00/0xefc4487a01806de4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ce6 expref: 4020 pid: 15114 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.405024:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5081, 88 off364144 00000004:00080000:2.0:1705683932.405025:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466957597ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405025:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c66d00/0xefc4487a01859fcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b4c expref: 5975 pid: 15191 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.405028:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.405029:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.405029:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.405038:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c66d00/0xefc4487a01859fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b4c expref: 5975 pid: 15191 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.405042:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c66d00/0xefc4487a01859fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b4c expref: 5975 pid: 15191 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.405049:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090132800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584500608:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.405051:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1125, 88 off82008 00000004:00080000:2.0:1705683932.405053:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466985187ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405059:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5082, 88 off364232 00000004:00080000:2.0:1705683932.405060:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705466992325ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405064:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1126, 88 off82096 00010000:00010000:3.0:1705683932.405064:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354ade00/0xefc4487a01806de4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ce6 expref: 4020 pid: 15114 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.405065:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705466997763ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405069:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5083, 88 off364320 00000004:00080000:2.0:1705683932.405070:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467002796ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405074:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1127, 88 off82184 00000004:00080000:2.0:1705683932.405075:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467007523ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405081:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354ade00/0xefc4487a01806de4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ce6 expref: 4020 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.405085:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090135000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584500672:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.405093:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5084, 88 off364408 00000004:00080000:2.0:1705683932.405094:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467026638ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405096:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012b274780 going to sleep for 11 seconds 00000040:00080000:2.0:1705683932.405099:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1128, 88 off82272 00000004:00080000:2.0:1705683932.405100:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467031983ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405103:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5085, 88 off364496 00010000:00010000:3.0:1705683932.405103:0:15148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.405105:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467037268ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405106:0:15148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405109:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1129, 88 off82360 00010000:00010000:3.0:1705683932.405109:0:15148:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.405110:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467042078ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405111:0:15148:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a01878641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.405117:0:15148:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:2.0:1705683932.405131:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5086, 88 off364584 00000004:00080000:2.0:1705683932.405133:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467064898ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405138:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1130, 88 off82448 00000004:00080000:2.0:1705683932.405140:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467071893ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405144:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5087, 88 off364672 00000004:00080000:2.0:1705683932.405145:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467077072ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405148:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1131, 88 off82536 00000004:00080000:2.0:1705683932.405149:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467081813ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405153:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5088, 88 off364760 00000004:00080000:2.0:1705683932.405154:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467086292ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405157:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1132, 88 off82624 00000004:00080000:2.0:1705683932.405159:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467090898ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405162:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5089, 88 off364848 00000004:00080000:2.0:1705683932.405163:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467095360ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405166:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5090, 88 off364936 00000004:00080000:2.0:1705683932.405168:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467100040ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405171:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5091, 88 off365024 00000004:00080000:2.0:1705683932.405172:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467104792ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405172:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3228:3082:x1788538584498112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5032us (5061us total) trans 4295348226 rc 0/0 00000040:00080000:2.0:1705683932.405176:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5092, 88 off365112 00000100:00100000:3.0:1705683932.405176:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920700 00000004:00080000:2.0:1705683932.405177:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467109332ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405180:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5093, 88 off365200 00000004:00080000:2.0:1705683932.405181:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467113707ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405185:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5094, 88 off365288 00000004:00080000:2.0:1705683932.405186:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467118090ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405189:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5095, 88 off365376 00000004:00080000:3.0:1705683932.405189:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099f0bc00/2, rc 0, transno 380930 00000004:00080000:2.0:1705683932.405190:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467122486ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405192:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584498112:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.405194:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5096, 88 off365464 00000004:00080000:2.0:1705683932.405195:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467126985ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405198:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5097, 88 off365552 00000004:00080000:2.0:1705683932.405199:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467131328ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405202:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5098, 88 off365640 00000004:00080000:2.0:1705683932.405203:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467135597ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405207:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5099, 88 off365728 00000004:00080000:2.0:1705683932.405208:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467139996ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405208:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405211:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5100, 88 off365816 00000004:00080000:2.0:1705683932.405212:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467144335ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405213:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405213:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.405215:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5101, 88 off365904 00000004:00080000:2.0:1705683932.405216:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467148716ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405216:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641018688 00000040:00080000:2.0:1705683932.405220:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5102, 88 off365992 00000004:00080000:2.0:1705683932.405221:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467152997ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405222:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405223:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.405224:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5103, 88 off366080 00000004:00080000:2.0:1705683932.405225:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467157266ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405225:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413391 00000100:00100000:3.0:1705683932.405227:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efc100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1920:7185:x1788538641018688:12345-192.168.203.41@tcp:36:rm.0 00000040:00080000:2.0:1705683932.405228:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5104, 88 off366168 00000004:00080000:2.0:1705683932.405229:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467161817ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405233:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5105, 88 off366256 00000004:00080000:2.0:1705683932.405234:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467166480ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405238:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5106, 88 off366344 00010000:00010000:3.0:1705683932.405238:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1705683932.405239:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467170928ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405242:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5107, 88 off366432 00000004:00080000:2.0:1705683932.405243:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467175278ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405244:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800998c9b80/0xefc4487a018781b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40d8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e70 expref: 1920 pid: 14256 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405246:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5108, 88 off366520 00000004:00080000:2.0:1705683932.405247:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467179716ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405250:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40d8:0x0].0x0 (ffff88012cc78a00) 00000040:00080000:2.0:1705683932.405251:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5109, 88 off366608 00010000:00010000:3.0:1705683932.405251:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1705683932.405252:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467184652ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405256:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5110, 88 off366696 00000004:00080000:2.0:1705683932.405257:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467189188ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405260:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5111, 88 off366784 00010000:00010000:3.0:1705683932.405260:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405261:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467193427ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405263:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405264:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5112, 88 off366872 00000004:00080000:2.0:1705683932.405265:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467197752ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405266:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405269:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5113, 88 off366960 00000004:00080000:2.0:1705683932.405270:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467201992ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405273:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5114, 88 off367048 00000004:00080000:2.0:1705683932.405274:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467206253ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405277:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5115, 88 off367136 00000004:00080000:2.0:1705683932.405278:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467210565ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405282:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5116, 88 off367224 00000004:00080000:2.0:1705683932.405283:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467214900ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405286:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5117, 88 off367312 00000004:00080000:2.0:1705683932.405287:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467219366ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405290:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5118, 88 off367400 00000004:00080000:2.0:1705683932.405291:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467223772ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405295:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5119, 88 off367488 00000004:00080000:2.0:1705683932.405296:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467228056ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405299:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5120, 88 off367576 00000004:00080000:2.0:1705683932.405300:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467232438ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405303:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5121, 88 off367664 00000004:00080000:2.0:1705683932.405304:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467236767ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405308:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5122, 88 off367752 00000004:00080000:2.0:1705683932.405309:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467241145ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405312:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5123, 88 off367840 00000004:00080000:2.0:1705683932.405313:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467245422ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405316:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5124, 88 off367928 00000004:00080000:2.0:1705683932.405317:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467249676ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405321:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5125, 88 off368016 00010000:00010000:3.0:1705683932.405321:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264f00/0xefc4487a01878736 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x40bb:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405322:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467253936ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405323:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098264f00/0xefc4487a01878736 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405325:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5126, 88 off368104 00000004:00080000:2.0:1705683932.405326:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467258235ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405326:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098264f00/0xefc4487a01878736 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405329:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5127, 88 off368192 00000004:00080000:2.0:1705683932.405330:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467262787ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405334:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5128, 88 off368280 00000004:00080000:2.0:1705683932.405335:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467267272ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405338:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5129, 88 off368368 00000004:00080000:2.0:1705683932.405340:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467272115ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405343:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5130, 88 off368456 00000004:00080000:2.0:1705683932.405344:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467276708ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405349:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405352:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5131, 88 off368544 00010000:00010000:3.0:1705683932.405352:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405353:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467284922ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405354:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:2.0:1705683932.405379:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.405380:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01878672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.405384:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013232ad00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.405385:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01878672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.405388:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01878672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.405393:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01878672 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.405396:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013232ad00/0xefc4487a01878672 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.405403:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.405403:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.405404:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.405409:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5133, 88 off368728 00000004:00080000:2.0:1705683932.405411:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467342815ns, next at 706174782226ns, rc = 0 00000040:00080000:3.0:1705683932.405413:0:6531:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].10157, 64 off658240 00000040:00080000:2.0:1705683932.405417:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5134, 88 off368816 00000004:00080000:2.0:1705683932.405419:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467350947ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405422:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5135, 88 off368904 00000004:00080000:2.0:1705683932.405423:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467355707ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405427:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5136, 88 off368992 00000004:00080000:2.0:1705683932.405428:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467360497ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405430:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405432:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5137, 88 off369080 00000004:00080000:2.0:1705683932.405433:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467365186ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405433:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405436:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5138, 88 off369168 00010000:00010000:3.0:1705683932.405436:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405437:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467369610ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405438:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405440:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405441:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5139, 88 off369256 00000004:00080000:2.0:1705683932.405442:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467373940ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405442:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405445:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5140, 88 off369344 00000004:00080000:2.0:1705683932.405446:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467378237ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405447:0:6531:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:2.0:1705683932.405449:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5141, 88 off369432 00000004:00080000:2.0:1705683932.405450:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467382555ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405452:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405454:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5142, 88 off369520 00000004:00080000:2.0:1705683932.405454:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467386832ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405456:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405458:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5143, 88 off369608 00000004:00080000:2.0:1705683932.405459:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467391120ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405459:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405460:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098264500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.405461:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405462:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5144, 88 off369696 00000004:00080000:2.0:1705683932.405463:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467395378ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405463:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405466:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5145, 88 off369784 00010000:00010000:3.0:1705683932.405466:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40d8:0x0].0x0 (ffff88012cc78a00) 00010000:00010000:3.0:1705683932.405466:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000004:00080000:2.0:1705683932.405467:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467399646ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405467:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405469:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098264500/0xefc4487a0187873d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x40d8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405471:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5146, 88 off369872 00000004:00080000:2.0:1705683932.405472:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467403963ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405475:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5147, 88 off369960 00000004:00080000:2.0:1705683932.405476:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467408235ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405479:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5148, 88 off370048 00000004:00080000:2.0:1705683932.405480:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467412508ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405484:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5149, 88 off370136 00000004:00080000:2.0:1705683932.405485:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467417236ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405488:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5150, 88 off370224 00000004:00080000:2.0:1705683932.405489:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467421798ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405493:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5151, 88 off370312 00000004:00080000:2.0:1705683932.405494:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467426832ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405498:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5152, 88 off370400 00000004:00080000:2.0:1705683932.405499:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467431287ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405502:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5153, 88 off370488 00000004:00080000:2.0:1705683932.405503:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467435695ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405503:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405505:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405507:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5154, 88 off370576 00010000:00010000:3.0:1705683932.405507:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405508:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467439962ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405508:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405510:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098267c00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.405511:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405512:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1133, 88 off82712 00000004:00080000:2.0:1705683932.405513:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467445660ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405514:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405516:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:3.0:1705683932.405517:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.405517:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 3/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405519:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5155, 88 off370664 00010000:00010000:3.0:1705683932.405519:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098267c00/0xefc4487a0187872f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405520:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467452150ns, next at 706174782226ns, rc = 0 00000004:00010000:3.0:1705683932.405522:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880097efc100 reply state ffff880084889000 transno 4295091437 ns: mdt-lustre-MDT0000_UUID lock: ffff880098264f00/0xefc4487a01878736 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405524:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1134, 88 off82800 00000004:00080000:2.0:1705683932.405525:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467456887ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405525:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098264f00/0xefc4487a01878736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x40bb:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405527:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x31 (ffff8800a1345800) 00010000:00010000:3.0:1705683932.405527:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:2.0:1705683932.405528:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5156, 88 off370752 00000004:00080000:2.0:1705683932.405529:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467461448ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405533:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1135, 88 off82888 00000004:00080000:2.0:1705683932.405534:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467466058ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405537:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5157, 88 off370840 00000004:00080000:2.0:1705683932.405539:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467471067ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405540:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efc100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1921:7185:x1788538641018688:12345-192.168.203.41@tcp:36:rm.0 Request processed in 312us (331us total) trans 4295091437 rc 0/0 00000040:00080000:2.0:1705683932.405542:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1136, 88 off82976 00000100:00100000:3.0:1705683932.405543:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413391 00000004:00080000:2.0:1705683932.405544:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467475990ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405547:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5158, 88 off370928 00000004:00080000:2.0:1705683932.405548:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467480462ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405552:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1137, 88 off83064 00000004:00080000:2.0:1705683932.405553:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467485378ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405556:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5159, 88 off371016 00000004:00080000:2.0:1705683932.405558:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467489912ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.405558:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135577300/2, rc 0, transno 380932 00000100:00100000:3.0:1705683932.405560:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135577300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584499008:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.405561:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1138, 88 off83152 00000004:00080000:2.0:1705683932.405562:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467494502ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405565:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000040:00080000:2.0:1705683932.405566:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5160, 88 off371104 00010000:00010000:3.0:1705683932.405566:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 00000004:00080000:2.0:1705683932.405567:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467498958ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405568:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098267480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.405569:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405570:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1139, 88 off83240 00000004:00080000:2.0:1705683932.405571:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467503385ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405572:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405574:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5161, 88 off371192 00000004:00080000:2.0:1705683932.405575:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467507733ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405575:0:15119:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40d8:0x0].0x0 (ffff88012cc78a00) 00010000:00010000:3.0:1705683932.405575:0:15119:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1705683932.405576:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.405578:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098267480/0xefc4487a01878744 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x40d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 00000040:00080000:2.0:1705683932.405579:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1140, 88 off83328 00000004:00080000:2.0:1705683932.405580:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467512166ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405581:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.405582:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.405583:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5162, 88 off371280 00010000:00010000:3.0:1705683932.405583:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.405584:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467516492ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405588:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1141, 88 off83416 00000004:00080000:2.0:1705683932.405588:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467520840ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405592:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5163, 88 off371368 00000004:00080000:2.0:1705683932.405593:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467525227ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405596:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1142, 88 off83504 00000004:00080000:2.0:1705683932.405597:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467529586ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405601:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5164, 88 off371456 00000004:00080000:2.0:1705683932.405602:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467533913ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405605:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1143, 88 off83592 00000004:00080000:2.0:1705683932.405606:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467538330ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405609:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5165, 88 off371544 00000004:00080000:2.0:1705683932.405611:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467542872ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405614:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1144, 88 off83680 00000100:00100000:3.0:1705683932.405614:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584499584:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.405615:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467547367ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405618:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5166, 88 off371632 00000004:00080000:2.0:1705683932.405619:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467551668ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405623:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1145, 88 off83768 00000004:00080000:2.0:1705683932.405624:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467556006ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405627:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5167, 88 off371720 00000004:00080000:2.0:1705683932.405629:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467560987ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405632:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1146, 88 off83856 00000100:00100000:3.0:1705683932.405632:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584499648:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.405633:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467565448ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405638:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5168, 88 off371808 00000004:00080000:2.0:1705683932.405639:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467571433ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405643:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1147, 88 off83944 00000004:00080000:2.0:1705683932.405644:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467575958ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405646:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405647:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5169, 88 off371896 00000004:00080000:2.0:1705683932.405648:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467580625ns, next at 706174782226ns, rc = 0 00010000:00100000:3.0:1705683932.405650:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.405651:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.405651:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000040:00080000:2.0:1705683932.405652:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1148, 88 off84032 00000004:00080000:2.0:1705683932.405653:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467585210ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405654:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1705683932.405658:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501056:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.405664:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5170, 88 off371984 00000004:00080000:2.0:1705683932.405665:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467597195ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405669:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.405673:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1149, 88 off84120 00000004:00080000:2.0:1705683932.405674:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467606793ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405677:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405678:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405680:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584501056 00000040:00080000:2.0:1705683932.405682:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5171, 88 off372072 00000004:00080000:2.0:1705683932.405683:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467615758ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405686:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405686:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405688:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920723 00000100:00100000:3.0:1705683932.405690:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3230:3082:x1788538584501056:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.405691:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1150, 88 off84208 00000004:00080000:2.0:1705683932.405693:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467624878ns, next at 706187302248ns, rc = 0 00002000:00080000:3.0:1705683932.405696:0:15169:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34508 count 1 00000040:00080000:2.0:1705683932.405700:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5172, 88 off372160 00000004:00080000:2.0:1705683932.405702:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467634103ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405718:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1151, 88 off84296 00000004:00080000:2.0:1705683932.405719:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467651688ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405728:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5173, 88 off372248 00000004:00080000:2.0:1705683932.405730:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467662403ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405735:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1152, 88 off84384 00000004:00080000:2.0:1705683932.405737:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467668976ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405744:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5174, 88 off372336 00000004:00080000:2.0:1705683932.405746:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467677858ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405750:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1153, 88 off84472 00000004:00080000:2.0:1705683932.405751:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467683763ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405760:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5175, 88 off372424 00000004:00080000:2.0:1705683932.405761:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467693476ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405767:0:15169:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405768:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1154, 88 off84560 00000004:00080000:2.0:1705683932.405770:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467702246ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405773:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e580/0xefc4487a01806e2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d2c expref: 4016 pid: 15217 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.405776:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a3c280/0xefc4487a01859feb lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b68 expref: 5974 pid: 15118 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.405777:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5176, 88 off372512 00000004:00080000:2.0:1705683932.405779:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467711093ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405779:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.405779:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.405780:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.405786:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1155, 88 off84648 00000004:00080000:2.0:1705683932.405788:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467719888ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405788:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a3c280/0xefc4487a01859feb lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b68 expref: 5974 pid: 15118 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.405791:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a3c280/0xefc4487a01859feb lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b68 expref: 5974 pid: 15118 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.405793:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5177, 88 off372600 00000004:00080000:2.0:1705683932.405794:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467726243ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405795:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584501120:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.405801:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1156, 88 off84736 00000004:00080000:2.0:1705683932.405803:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467734948ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405806:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5178, 88 off372688 00000004:00080000:2.0:1705683932.405807:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467739768ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405808:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e580/0xefc4487a01806e2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d2c expref: 4016 pid: 15217 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.405813:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1157, 88 off84824 00000004:00080000:2.0:1705683932.405814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467746558ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.405814:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e580/0xefc4487a01806e2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d2c expref: 4016 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.405817:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584501184:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.405822:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008a3b7300 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.405833:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584498816:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.405836:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584499712:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.405838:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5179, 88 off372776 00000004:00080000:2.0:1705683932.405840:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467772553ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.405844:0:15135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.405847:0:15135:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.405847:0:15135:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.405848:0:15135:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405871:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d5a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501248:0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.405874:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1158, 88 off84912 00000004:00080000:2.0:1705683932.405875:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467807706ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405880:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5180, 88 off372864 00000004:00080000:2.0:1705683932.405881:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467813573ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405881:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.405887:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1159, 88 off85000 00000004:00080000:2.0:1705683932.405888:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467820546ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405892:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5181, 88 off372952 00000004:00080000:2.0:1705683932.405893:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467825545ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405894:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405899:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1160, 88 off85088 00000004:00080000:2.0:1705683932.405900:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467832138ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405903:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5182, 88 off373040 00000004:00080000:2.0:1705683932.405905:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467836903ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405905:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405910:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1161, 88 off85176 00000004:00080000:2.0:1705683932.405911:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467843228ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405915:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5183, 88 off373128 00000004:00080000:2.0:1705683932.405916:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467847888ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405916:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405921:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1162, 88 off85264 00000004:00080000:2.0:1705683932.405922:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467854226ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405924:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405926:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5184, 88 off373216 00000004:00080000:2.0:1705683932.405927:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467858923ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405932:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1163, 88 off85352 00000004:00080000:2.0:1705683932.405933:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467865198ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405933:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405936:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5185, 88 off373304 00000004:00080000:2.0:1705683932.405937:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467869765ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405943:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1164, 88 off85440 00000100:00100000:3.0:1705683932.405943:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000004:00080000:2.0:1705683932.405944:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467876358ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405948:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5186, 88 off373392 00000004:00080000:2.0:1705683932.405949:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467881093ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405951:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:2.0:1705683932.405954:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1165, 88 off85528 00000004:00080000:2.0:1705683932.405955:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467887366ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405955:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405956:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.405959:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5187, 88 off373480 00000004:00080000:2.0:1705683932.405960:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467891963ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405960:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641019264 00000040:00080000:2.0:1705683932.405965:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1166, 88 off85616 00000004:00080000:2.0:1705683932.405966:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467898290ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.405968:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.405968:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.405970:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5188, 88 off373568 00000100:00100000:3.0:1705683932.405970:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413392 00000004:00080000:2.0:1705683932.405971:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467902883ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.405972:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1877:7327:x1788538641019264:12345-192.168.203.41@tcp:101:lfs.0 00000040:00080000:2.0:1705683932.405976:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1167, 88 off85704 00010000:00010000:3.0:1705683932.405976:0:14233:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1705683932.405977:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467909203ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405980:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5189, 88 off373656 00000004:00080000:2.0:1705683932.405981:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467913823ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405987:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1168, 88 off85792 00000004:00080000:2.0:1705683932.405988:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467920045ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.405991:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5190, 88 off373744 00000004:00080000:2.0:1705683932.405992:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467924705ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.405998:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1169, 88 off85880 00000004:00080000:2.0:1705683932.405999:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705467931056ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406004:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5191, 88 off373832 00000004:00080000:2.0:1705683932.406005:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705467937613ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.406010:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d8d5a00/2, rc 0, transno 380935 00000100:00100000:3.0:1705683932.406019:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d5a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501248:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.406026:0:14233:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098267980/0xefc4487a01878759 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301030 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.406038:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584501312:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.406038:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406039:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406041:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641019392 00010000:00010000:3.0:1705683932.406046:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135218780/0xefc4487a01859fc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b29 expref: 5977 pid: 15185 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.406053:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406054:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.406055:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.406056:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332877 00000100:00100000:3.0:1705683932.406058:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4019:1854:x1788538641018944:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.406061:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.406062:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4019 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406066:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4019 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406072:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a7700/0xefc4487a01806d7b lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1c7d expref: 4019 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406089:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:2.0:1705683932.406093:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1170, 88 off85968 00000004:00080000:2.0:1705683932.406097:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468028958ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406097:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:1854:x1788538641018944:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.406100:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332877 00000100:00100000:3.0:1705683932.406105:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406106:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406108:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332879 00000040:00080000:2.0:1705683932.406109:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5192, 88 off373920 00000100:00100000:3.0:1705683932.406109:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5978:1854:x1788538641018880:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1705683932.406111:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468043225ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406112:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.406113:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406117:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406123:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c67980/0xefc4487a01859fb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b1b expref: 5978 pid: 15191 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406128:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.406129:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.406129:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.406132:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.406142:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.406148:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5975:1854:x1788538641018880:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 38us (232us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.406149:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1171, 88 off86056 00000100:00100000:3.0:1705683932.406151:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332879 00000004:00080000:2.0:1705683932.406152:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468083808ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406154:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406155:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406156:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332881 00000100:00100000:3.0:1705683932.406158:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5973:1854:x1788538641019392:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000040:00080000:2.0:1705683932.406159:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5193, 88 off374008 00000004:00080000:2.0:1705683932.406160:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468092238ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406160:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.406162:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135218780/0xefc4487a01859fc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b29 expref: 5973 pid: 15185 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.406166:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135218780/0xefc4487a01859fc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b29 expref: 5973 pid: 15185 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.406168:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1172, 88 off86144 00000004:00080000:2.0:1705683932.406170:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468102066ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406171:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135218780/0xefc4487a01859fc1 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b29 expref: 5973 pid: 15185 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.406174:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5194, 88 off374096 00000004:00080000:2.0:1705683932.406175:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468107356ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406176:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.406177:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.406178:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d562300/0xefc4487a018786e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.406181:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1173, 88 off86232 00000004:00080000:2.0:1705683932.406182:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468114308ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406182:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d562300/0xefc4487a018786e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.406186:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5195, 88 off374184 00000004:00080000:2.0:1705683932.406187:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468119243ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406192:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1174, 88 off86320 00000004:00080000:2.0:1705683932.406193:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468125628ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406195:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:2.0:1705683932.406197:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5196, 88 off374272 00000004:00080000:2.0:1705683932.406198:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468130486ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406203:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1175, 88 off86408 00000004:00080000:2.0:1705683932.406205:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468137105ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406207:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:1854:x1788538641019392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 47us (272us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.406208:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5197, 88 off374360 00000004:00080000:2.0:1705683932.406209:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468141700ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406210:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332881 00000040:00080000:2.0:1705683932.406215:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1176, 88 off86496 00000004:00080000:2.0:1705683932.406216:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468148160ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406219:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5198, 88 off374448 00000004:00080000:2.0:1705683932.406221:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468153199ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406226:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1177, 88 off86584 00000004:00080000:2.0:1705683932.406227:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468159415ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406231:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5199, 88 off374536 00000004:00080000:2.0:1705683932.406232:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468163993ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406237:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1178, 88 off86672 00000004:00080000:2.0:1705683932.406238:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468170240ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406241:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5200, 88 off374624 00000004:00080000:2.0:1705683932.406242:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468174769ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406248:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1179, 88 off86760 00000004:00080000:2.0:1705683932.406249:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468180919ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406252:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5201, 88 off374712 00000004:00080000:2.0:1705683932.406253:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468185490ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406258:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1180, 88 off86848 00000004:00080000:2.0:1705683932.406259:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468191665ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406260:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.406263:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5202, 88 off374800 00000004:00080000:2.0:1705683932.406264:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468196266ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406265:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.406269:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1181, 88 off86936 00010000:00010000:3.0:1705683932.406269:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.406270:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468202453ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406273:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.406274:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5203, 88 off374888 00000004:00080000:2.0:1705683932.406275:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468207084ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406285:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1705683932.406288:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.406289:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.406293:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a455b80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.406294:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.406297:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.406302:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.406304:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a455b80/0xefc4487a018786db lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.406313:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.406313:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.406314:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.406316:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1182, 88 off87024 00000004:00080000:2.0:1705683932.406317:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468249486ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406325:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5204, 88 off374976 00000004:00080000:2.0:1705683932.406326:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468258799ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406333:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1183, 88 off87112 00000004:00080000:2.0:1705683932.406335:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468267165ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406345:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5205, 88 off375064 00000004:00080000:2.0:1705683932.406347:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468279104ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406367:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135572800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3235:3084:x1788538584499392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4343us (4811us total) trans 4295348232 rc 0/0 00000100:00100000:3.0:1705683932.406371:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920711 00000004:00080000:2.0:1705683932.406373:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135574b00/2, rc 0, transno 380936 00000100:00100000:2.0:1705683932.406378:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135574b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584499392:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1705683932.406384:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135571e00/2, rc 0, transno 380937 00000100:00100000:3.0:1705683932.406386:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584499776:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.406414:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.406418:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584501504:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.406430:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.406445:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1184, 88 off87200 00000100:00100000:3.0:1705683932.406445:0:3082:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1705683932.406447:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468379616ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406452:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501568:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.406456:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5206, 88 off375152 00000004:00080000:2.0:1705683932.406458:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468390005ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406464:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1185, 88 off87288 00000004:00080000:2.0:1705683932.406465:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468397553ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406468:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.406470:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5207, 88 off375240 00000004:00080000:2.0:1705683932.406472:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468403920ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406477:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1186, 88 off87376 00000004:00080000:2.0:1705683932.406478:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468410580ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406481:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406482:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.406484:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5208, 88 off375328 00000004:00080000:2.0:1705683932.406485:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468417070ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406486:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584501504 00000040:00080000:2.0:1705683932.406490:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1187, 88 off87464 00000004:00080000:2.0:1705683932.406491:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468423384ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406495:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406495:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.406496:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5209, 88 off375416 00000004:00080000:2.0:1705683932.406497:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468429618ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406497:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584501568 00000040:00080000:2.0:1705683932.406502:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1188, 88 off87552 00000004:00080000:2.0:1705683932.406504:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468435879ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406509:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5210, 88 off375504 00000004:00080000:2.0:1705683932.406510:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468442148ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406510:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406511:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406513:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920728 00000040:00080000:2.0:1705683932.406515:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1189, 88 off87640 00000004:00080000:2.0:1705683932.406516:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468448394ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406516:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8d1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3235:3083:x1788538584501504:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.406521:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5211, 88 off375592 00000004:00080000:2.0:1705683932.406522:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468454535ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406528:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1190, 88 off87728 00000004:00080000:2.0:1705683932.406529:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468461069ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406534:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5212, 88 off375680 00000004:00080000:2.0:1705683932.406535:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468467546ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406540:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1191, 88 off87816 00000004:00080000:2.0:1705683932.406541:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468473806ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406547:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5213, 88 off375768 00000004:00080000:2.0:1705683932.406548:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468480663ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406554:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1192, 88 off87904 00000004:00080000:2.0:1705683932.406555:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468487238ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406560:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5214, 88 off375856 00000004:00080000:2.0:1705683932.406561:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468493559ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406566:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1193, 88 off87992 00000004:00080000:2.0:1705683932.406568:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468499858ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406573:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5215, 88 off375944 00000004:00080000:2.0:1705683932.406574:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468506109ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406579:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1194, 88 off88080 00000004:00080000:2.0:1705683932.406580:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468512373ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406585:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5216, 88 off376032 00000004:00080000:2.0:1705683932.406586:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468518568ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406591:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1195, 88 off88168 00000004:00080000:2.0:1705683932.406592:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468524833ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406598:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5217, 88 off376120 00000004:00080000:2.0:1705683932.406599:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468530980ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406604:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1196, 88 off88256 00000004:00080000:2.0:1705683932.406605:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468537269ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406610:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5218, 88 off376208 00000004:00080000:2.0:1705683932.406611:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468543370ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406616:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1197, 88 off88344 00000004:00080000:2.0:1705683932.406617:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468549544ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406623:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5219, 88 off376296 00000004:00080000:2.0:1705683932.406624:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468556114ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406629:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1198, 88 off88432 00000004:00080000:2.0:1705683932.406630:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468562330ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406635:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5220, 88 off376384 00000004:00080000:2.0:1705683932.406636:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468568534ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406641:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1199, 88 off88520 00000004:00080000:2.0:1705683932.406642:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468574705ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406647:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5221, 88 off376472 00000004:00080000:2.0:1705683932.406649:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468580928ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406654:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1200, 88 off88608 00000004:00080000:2.0:1705683932.406655:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468587125ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406660:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5222, 88 off376560 00000004:00080000:2.0:1705683932.406661:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468593248ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406666:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1201, 88 off88696 00000004:00080000:2.0:1705683932.406667:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468599408ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406672:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5223, 88 off376648 00000004:00080000:2.0:1705683932.406673:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468605528ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406678:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1202, 88 off88784 00000004:00080000:2.0:1705683932.406679:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468611760ns, next at 706187302248ns, rc = 0 00002000:00010000:3.0:1705683932.406682:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95d6:0x0] updating lvb size from disk: 0 -> 0 00000040:00080000:2.0:1705683932.406684:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5224, 88 off376736 00002000:00010000:3.0:1705683932.406684:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95d6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.406685:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95d6:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:2.0:1705683932.406686:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468617918ns, next at 706174782226ns, rc = 0 00002000:00010000:3.0:1705683932.406686:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95d6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.406687:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95d6:0x0] updating lvb blocks from disk: 0 -> 0 00000040:00080000:2.0:1705683932.406691:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1203, 88 off88872 00000004:00080000:2.0:1705683932.406692:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468624530ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406728:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8d1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3236:3083:x1788538584501504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 210us (296us total) trans 4295348234 rc 0/0 00000004:00080000:2.0:1705683932.406729:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d8d5f00/2, rc 0, transno 380938 00000100:00100000:2.0:1705683932.406732:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584501504:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.406732:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920728 00010000:00010000:3.0:1705683932.406745:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:3.0:1705683932.406752:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406757:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.406774:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5226, 88 off376920 00000004:00080000:2.0:1705683932.406777:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468709414ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406788:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1204, 88 off88960 00000004:00080000:2.0:1705683932.406789:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468721388ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406795:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5227, 88 off377008 00000004:00080000:2.0:1705683932.406797:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468729093ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406802:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1205, 88 off89048 00000004:00080000:2.0:1705683932.406803:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468735699ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406809:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5228, 88 off377096 00000004:00080000:2.0:1705683932.406810:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468742204ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406815:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1206, 88 off89136 00000004:00080000:2.0:1705683932.406816:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468748813ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406822:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5229, 88 off377184 00000004:00080000:2.0:1705683932.406823:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468755075ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406823:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406824:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406827:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584501760 00000040:00080000:2.0:1705683932.406828:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1207, 88 off89224 00000004:00080000:2.0:1705683932.406829:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468761363ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406834:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5230, 88 off377272 00000004:00080000:2.0:1705683932.406835:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468767840ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406836:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406836:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.406839:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920730 00000040:00080000:2.0:1705683932.406841:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1208, 88 off89312 00000100:00100000:3.0:1705683932.406841:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3236:3081:x1788538584501760:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.406842:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468774136ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406847:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5231, 88 off377360 00000004:00080000:2.0:1705683932.406848:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468780344ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406853:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1209, 88 off89400 00000004:00080000:2.0:1705683932.406854:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468786480ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406859:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5232, 88 off377448 00000004:00080000:2.0:1705683932.406860:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468792655ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406865:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1210, 88 off89488 00000004:00080000:2.0:1705683932.406867:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468798993ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406872:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5233, 88 off377536 00000004:00080000:2.0:1705683932.406873:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468805149ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406878:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1211, 88 off89576 00000004:00080000:2.0:1705683932.406879:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468811303ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406884:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5234, 88 off377624 00000004:00080000:2.0:1705683932.406885:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468817556ns, next at 706174782226ns, rc = 0 00002000:00010000:3.0:1705683932.406889:0:15188:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95d7:0x0] updating lvb size from disk: 0 -> 0 00000040:00080000:2.0:1705683932.406890:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1212, 88 off89664 00002000:00010000:3.0:1705683932.406891:0:15188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95d7:0x0] updating lvb mtime from disk: 0 -> 0 00000004:00080000:2.0:1705683932.406892:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468824649ns, next at 706187302248ns, rc = 0 00002000:00010000:3.0:1705683932.406892:0:15188:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.406893:0:15188:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95d7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.406894:0:15188:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95d7:0x0] updating lvb blocks from disk: 0 -> 0 00000040:00080000:2.0:1705683932.406898:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5235, 88 off377712 00000004:00080000:2.0:1705683932.406899:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468831131ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406904:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1213, 88 off89752 00000004:00080000:2.0:1705683932.406905:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468837386ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406910:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5236, 88 off377800 00000004:00080000:2.0:1705683932.406911:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468843716ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.406916:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1214, 88 off89840 00000004:00080000:2.0:1705683932.406918:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468849856ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.406921:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3237:3081:x1788538584501760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (151us total) trans 4295348235 rc 0/0 00000040:00080000:2.0:1705683932.406923:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5237, 88 off377888 00000004:00080000:2.0:1705683932.406924:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468856104ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.406925:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920730 00000040:00080000:2.0:1705683932.406929:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1215, 88 off89928 00000004:00080000:2.0:1705683932.406930:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468862571ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.406935:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5238, 88 off377976 00000004:00080000:2.0:1705683932.406937:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468869041ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406937:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00000040:00080000:2.0:1705683932.406941:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1216, 88 off90016 00000004:00080000:2.0:1705683932.406942:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468874731ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406942:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406946:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.406948:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5239, 88 off378064 00000004:00080000:2.0:1705683932.406949:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468881166ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406959:0:14233:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406962:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406966:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406969:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406972:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098264c80 already unused, calling callback (ffffffffa0d756d0) 00000040:00080000:2.0:1705683932.406973:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1218, 88 off90200 00010000:00010000:3.0:1705683932.406973:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00000004:00080000:2.0:1705683932.406975:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468907151ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406979:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.406984:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5240, 88 off378152 00010000:00010000:3.0:1705683932.406984:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.406985:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:2.0:1705683932.406986:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468918054ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.406986:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406988:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098264c80/0xefc4487a01878798 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406991:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.406992:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1219, 88 off90288 00000004:00080000:2.0:1705683932.406993:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468925396ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.406993:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406995:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.406997:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098266580 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.406998:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.406999:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5241, 88 off378240 00010000:00010000:3.0:1705683932.406999:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00000004:00080000:2.0:1705683932.407000:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468932181ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407002:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800a1345300) 00010000:00010000:3.0:1705683932.407002:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.407003:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.407004:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098266580/0xefc4487a018787c2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00000040:00080000:2.0:1705683932.407005:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1220, 88 off90376 00000004:00080000:2.0:1705683932.407006:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468938549ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407012:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5242, 88 off378328 00000004:00080000:2.0:1705683932.407013:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468945366ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407018:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1221, 88 off90464 00000004:00080000:2.0:1705683932.407019:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468951321ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407022:0:14233:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098267980/0xefc4487a01878759 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301030 expref: 1878 pid: 14233 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407024:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5243, 88 off378416 00010000:00010000:3.0:1705683932.407025:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098267980/0xefc4487a01878759 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301030 expref: 1878 pid: 14233 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.407026:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468958001ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407028:0:14233:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098267980, rc 0) 00000040:00080000:2.0:1705683932.407030:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1222, 88 off90552 00000004:00080000:2.0:1705683932.407031:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468963624ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407036:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5244, 88 off378504 00000100:00100000:3.0:1705683932.407036:0:14233:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1877:7327:x1788538641019264:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1063us (1084us total) trans 0 rc 301/301 00000004:00080000:2.0:1705683932.407038:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468969909ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407038:0:14233:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413392 00000040:00080000:2.0:1705683932.407042:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1223, 88 off90640 00000004:00080000:2.0:1705683932.407043:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468975414ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407047:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407047:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.407048:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5245, 88 off378592 00000004:00080000:2.0:1705683932.407049:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468981604ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407049:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584501824 00000040:00080000:2.0:1705683932.407054:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1224, 88 off90728 00000004:00080000:2.0:1705683932.407055:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468987254ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407055:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407056:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407057:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920731 00000100:00100000:3.0:1705683932.407059:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3237:3084:x1788538584501824:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.407060:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5246, 88 off378680 00000004:00080000:2.0:1705683932.407061:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705468993756ns, next at 706174782226ns, rc = 0 00002000:00080000:3.0:1705683932.407064:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34511 count 1 00000040:00080000:2.0:1705683932.407066:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1225, 88 off90816 00000004:00080000:2.0:1705683932.407067:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705468999499ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407072:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5247, 88 off378768 00000004:00080000:2.0:1705683932.407073:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469005706ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407095:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1226, 88 off90904 00000004:00080000:2.0:1705683932.407097:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469029468ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407104:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5248, 88 off378856 00000004:00080000:2.0:1705683932.407105:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469037289ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407110:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1227, 88 off90992 00000004:00080000:2.0:1705683932.407111:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469043834ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407117:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5249, 88 off378944 00000004:00080000:2.0:1705683932.407118:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469050239ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407122:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1228, 88 off91080 00000004:00080000:2.0:1705683932.407123:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469055029ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407129:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5250, 88 off379032 00000004:00080000:2.0:1705683932.407130:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469062044ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407133:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1229, 88 off91168 00000004:00080000:2.0:1705683932.407135:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469066879ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407140:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5251, 88 off379120 00000004:00080000:2.0:1705683932.407141:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469073309ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407145:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1230, 88 off91256 00000004:00080000:2.0:1705683932.407146:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469078644ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407152:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5252, 88 off379208 00000004:00080000:2.0:1705683932.407153:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469085226ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407157:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1231, 88 off91344 00000004:00080000:2.0:1705683932.407158:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469090106ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407163:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5253, 88 off379296 00000004:00080000:2.0:1705683932.407164:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469096743ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407168:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1232, 88 off91432 00000004:00080000:2.0:1705683932.407169:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469101476ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407174:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5254, 88 off379384 00000004:00080000:2.0:1705683932.407175:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469107681ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407179:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1233, 88 off91520 00000004:00080000:2.0:1705683932.407180:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469112339ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407185:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5255, 88 off379472 00000004:00080000:2.0:1705683932.407186:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469118709ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407190:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1234, 88 off91608 00000004:00080000:2.0:1705683932.407191:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469123471ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407196:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5256, 88 off379560 00000004:00080000:2.0:1705683932.407197:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469129681ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407201:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1235, 88 off91696 00000004:00080000:2.0:1705683932.407202:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469134308ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407207:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5257, 88 off379648 00000004:00080000:2.0:1705683932.407208:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469140539ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407212:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1236, 88 off91784 00000004:00080000:2.0:1705683932.407213:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469145391ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407218:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5258, 88 off379736 00000004:00080000:2.0:1705683932.407220:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469151906ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407225:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407229:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1237, 88 off91872 00000004:00080000:2.0:1705683932.407230:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469162593ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407230:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f480/0xefc4487a01806ea1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d95 expref: 4013 pid: 15173 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.407234:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d349b80/0xefc4487a01859ff9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b99 expref: 5971 pid: 15103 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.407236:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5259, 88 off379824 00010000:00010000:3.0:1705683932.407236:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.407237:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469169551ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407237:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.407238:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407246:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1238, 88 off91960 00010000:00010000:3.0:1705683932.407246:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d349b80/0xefc4487a01859ff9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b99 expref: 5971 pid: 15103 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.407247:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469179326ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407250:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d349b80/0xefc4487a01859ff9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8b99 expref: 5971 pid: 15103 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.407253:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5260, 88 off379912 00000004:00080000:2.0:1705683932.407254:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469186413ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407255:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584501888:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.407258:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1239, 88 off92048 00000004:00080000:2.0:1705683932.407259:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469191603ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407265:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5261, 88 off380000 00000004:00080000:2.0:1705683932.407266:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469198217ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407266:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f480/0xefc4487a01806ea1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d95 expref: 4013 pid: 15173 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.407270:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f480/0xefc4487a01806ea1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1d95 expref: 4013 pid: 15173 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.407271:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1240, 88 off92136 00000004:00080000:2.0:1705683932.407272:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469204223ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407273:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584501952:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.407277:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5262, 88 off380088 00000100:00100000:3.0:1705683932.407277:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880094e89180 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.407278:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469210501ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407283:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1241, 88 off92224 00000004:00080000:2.0:1705683932.407284:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469216779ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407284:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407284:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407287:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641019648 00000040:00080000:2.0:1705683932.407290:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5263, 88 off380176 00000004:00080000:2.0:1705683932.407291:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469223503ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407295:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1242, 88 off92312 00000100:00100000:3.0:1705683932.407295:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407295:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.407296:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469228251ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407297:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413393 00000100:00100000:3.0:1705683932.407299:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e38a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1846:7332:x1788538641019648:12345-192.168.203.41@tcp:36:lfs.0 00000040:00080000:2.0:1705683932.407301:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5264, 88 off380264 00000004:00080000:2.0:1705683932.407302:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469234487ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407306:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1243, 88 off92400 00000004:00080000:2.0:1705683932.407307:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469239074ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407307:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407308:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407311:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332883 00000040:00080000:2.0:1705683932.407312:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5265, 88 off380352 00000004:00080000:2.0:1705683932.407313:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469245311ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407313:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e285000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1877:1854:x1788538641019712:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.407316:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1705683932.407317:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.407318:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.407318:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131b37c00/0xefc4487a01873b71 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ffac7 expref: 1877 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1705683932.407322:0:6533:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641019968 00010000:00010000:3.0:1705683932.407322:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131b37c00/0xefc4487a01873b71 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ffac7 expref: 1877 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.407327:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b37c00/0xefc4487a01873b71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ffac7 expref: 1878 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1705683932.407330:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.407331:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.407331:0:15209:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00000100:00100000:2.0:1705683932.407333:0:6533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413394 00010000:00010000:3.0:1705683932.407333:0:15209:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01878625 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a0187861e expref: 38 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1705683932.407336:0:6533:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e286e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1877:16427:x1788538641019968:12345-192.168.203.41@tcp:36:dir_create.sh.0 00010000:00010000:3.0:1705683932.407337:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01878625 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a0187861e expref: 38 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.407339:0:15209:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01878625 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a0187861e expref: 38 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.407346:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880132328000/0xefc4487a01878625 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3fe1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a0187861e expref: 38 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.407347:0:6533:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.407349:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001_UUID:15209:1788538584502016:0@lo:105: 00010000:00010000:2.0:1705683932.407353:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998caa80/0xefc4487a01878713 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4155:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301022 expref: 1877 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.407359:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4155:0x0].0x0 (ffff88011d9b7400) 00000100:00100000:3.0:1705683932.407360:0:15209:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1705683932.407361:0:6533:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.407373:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012b274840 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.407379:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407379:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407382:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641019776 00000100:00100000:3.0:1705683932.407388:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407388:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407390:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920732 00000100:00100000:3.0:1705683932.407392:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e281400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3531:6496:x1788538641019776:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.407395:0:15188:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1705683932.407405:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a018787fa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x4155:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:2.0:1705683932.407409:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a018787fa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4155:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:2.0:1705683932.407412:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a018787fa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4155:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000001:00080000:2.0:1705683932.407424:0:6533:0:(tgt_lastrcvd.c:2105:tgt_txn_stop_cb()) More than one transaction 4295084953 00000004:00010000:2.0:1705683932.407430:0:6533:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88009e286e00 reply state ffff880134f8f000 transno 4295084954 ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a018787fa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4155:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00010000:00010000:2.0:1705683932.407434:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800998ca080/0xefc4487a018787fa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x4155:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:2.0:1705683932.407436:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4155:0x0].0x0 (ffff88011d9b7400) 00010000:00010000:2.0:1705683932.407437:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1705683932.407454:0:6533:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e286e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1878:16427:x1788538641019968:12345-192.168.203.41@tcp:36:dir_create.sh.0 Request processed in 118us (144us total) trans 4295084954 rc 0/0 00000100:00100000:2.0:1705683932.407457:0:6533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413394 00000020:00080000:2.0:1705683932.407459:0:6533:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1705683932.407474:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1244, 88 off92488 00000004:00080000:2.0:1705683932.407476:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469408108ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407486:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5266, 88 off380440 00000004:00080000:2.0:1705683932.407487:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469419343ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407492:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1245, 88 off92576 00000004:00080000:2.0:1705683932.407494:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469425896ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407499:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5267, 88 off380528 00000004:00080000:2.0:1705683932.407500:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469432501ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407505:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1246, 88 off92664 00000004:00080000:2.0:1705683932.407506:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469438494ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407511:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5268, 88 off380616 00000004:00080000:2.0:1705683932.407513:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469445083ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407517:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1247, 88 off92752 00000004:00080000:2.0:1705683932.407519:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469451023ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407524:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5269, 88 off380704 00000004:00080000:2.0:1705683932.407525:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469457266ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407530:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1248, 88 off92840 00000004:00080000:2.0:1705683932.407531:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469463439ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407536:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5270, 88 off380792 00000004:00080000:2.0:1705683932.407538:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469469883ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407542:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1249, 88 off92928 00000004:00080000:2.0:1705683932.407543:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469475696ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407544:0:15188:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098265e00/0xefc4487a01878801 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301037 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407549:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5271, 88 off380880 00002000:00010000:3.0:1705683932.407550:0:15188:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1705683932.407551:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469482841ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407555:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:2.0:1705683932.407556:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1250, 88 off93016 00010000:00010000:3.0:1705683932.407556:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.407557:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469489551ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407557:0:15188:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098265e00/0xefc4487a01878801 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301037 expref: 3531 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.407562:0:15188:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098265e00/0xefc4487a01878801 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301037 expref: 3531 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.407565:0:15188:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098265e00, rc 0) 00000100:00100000:3.0:1705683932.407573:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e281400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3531:6496:x1788538641019776:12345-192.168.203.41@tcp:101:dd.0 Request processed in 180us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.407576:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920732 00000100:00100000:3.0:1705683932.407580:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407581:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407582:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641020032 00000040:00080000:2.0:1705683932.407584:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5272, 88 off380968 00000004:00080000:2.0:1705683932.407586:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469518287ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407588:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407588:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407589:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641020096 00000040:00080000:2.0:1705683932.407592:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1251, 88 off93104 00000100:00100000:3.0:1705683932.407593:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.407594:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469525984ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407594:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407595:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920733 00000100:00100000:3.0:1705683932.407597:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e280500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:4708:x1788538641020032:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.407600:0:15188:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:2.0:1705683932.407601:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5273, 88 off381056 00000004:00080000:2.0:1705683932.407602:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469534256ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407608:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1252, 88 off93192 00000004:00080000:2.0:1705683932.407609:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469541541ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407615:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5274, 88 off381144 00000004:00080000:2.0:1705683932.407616:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469548313ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407620:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1253, 88 off93280 00000004:00080000:2.0:1705683932.407621:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469553247ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407622:0:15188:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098265400/0xefc4487a01878808 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30103e expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407626:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5275, 88 off381232 00000004:00080000:2.0:1705683932.407627:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469559624ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407629:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1f98000/0xefc4487a01847a0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc7e expref: 5972 pid: 15219 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.407631:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1254, 88 off93368 00000004:00080000:2.0:1705683932.407632:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469564484ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407632:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.407632:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.407633:0:15188:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098265400/0xefc4487a01878808 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30103e expref: 4015 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407637:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5276, 88 off381320 00000004:00080000:2.0:1705683932.407638:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469570828ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407640:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1f98000/0xefc4487a01847a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc7e expref: 5972 pid: 15219 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.407642:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1255, 88 off93456 00000004:00080000:2.0:1705683932.407643:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469575473ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407643:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1f98000/0xefc4487a01847a0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc7e expref: 5972 pid: 15219 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.407647:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584502272:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.407649:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5277, 88 off381408 00000004:00080000:2.0:1705683932.407650:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469581949ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407654:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1256, 88 off93544 00000004:00080000:2.0:1705683932.407655:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469586987ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407655:0:15188:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012b274840 going to sleep for 11 seconds 00000040:00080000:2.0:1705683932.407660:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5278, 88 off381496 00000004:00080000:2.0:1705683932.407661:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469593317ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407665:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1257, 88 off93632 00000004:00080000:2.0:1705683932.407666:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469597974ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407671:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5279, 88 off381584 00000004:00080000:2.0:1705683932.407672:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469604469ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407676:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1258, 88 off93720 00000004:00080000:2.0:1705683932.407677:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469609181ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407681:0:14233:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:14233:1788538584502336:0@lo:1000:mdt00_020.0 00000040:00080000:2.0:1705683932.407682:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5280, 88 off381672 00000004:00080000:2.0:1705683932.407683:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469615491ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407687:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1259, 88 off93808 00000004:00080000:2.0:1705683932.407688:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469620201ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407692:0:14233:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.407693:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5281, 88 off381760 00000004:00080000:2.0:1705683932.407694:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469626441ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407698:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1260, 88 off93896 00000004:00080000:2.0:1705683932.407699:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469631069ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407704:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5282, 88 off381848 00000100:00100000:3.0:1705683932.407704:0:14233:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012d227300 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.407705:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469637239ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.407721:0:15135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407722:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1261, 88 off93984 00000004:00080000:2.0:1705683932.407723:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469655584ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.407725:0:15135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.407728:0:15135:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.407730:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5283, 88 off381936 00010000:00010000:3.0:1705683932.407730:0:15135:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5f480/0xefc4487a01878656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.407732:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469663848ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407736:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1262, 88 off94072 00010000:00010000:3.0:1705683932.407736:0:15135:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1705683932.407737:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469669171ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407742:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5284, 88 off382024 00000004:00080000:2.0:1705683932.407744:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469675874ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407747:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1263, 88 off94160 00000004:00080000:2.0:1705683932.407748:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469680607ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407753:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5285, 88 off382112 00000004:00080000:2.0:1705683932.407755:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469686856ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407758:0:14233:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:14233:1788538584502336:0@lo:1000:mdt00_020.0 00000040:00080000:2.0:1705683932.407777:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1264, 88 off94248 00000100:00100000:3.0:1705683932.407778:0:14233:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-mdtlov_UUID:14233:1788538584502464:0@lo:1000:mdt00_020.0 00000004:00080000:2.0:1705683932.407779:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469710841ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407788:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5286, 88 off382200 00000004:00080000:2.0:1705683932.407789:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469721499ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407789:0:14233:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.407795:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1265, 88 off94336 00000004:00080000:2.0:1705683932.407796:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469728454ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407800:0:14233:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba840 going to sleep for 11 seconds 00000040:00080000:2.0:1705683932.407802:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5287, 88 off382288 00000004:00080000:2.0:1705683932.407803:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469735183ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407807:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1266, 88 off94424 00000004:00080000:2.0:1705683932.407808:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469740147ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407813:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5288, 88 off382376 00000004:00080000:2.0:1705683932.407814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469746613ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407818:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1267, 88 off94512 00000004:00080000:2.0:1705683932.407819:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469751266ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407821:0:14257:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407822:0:14257:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.407824:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5289, 88 off382464 00000004:00080000:2.0:1705683932.407825:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469757761ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407826:0:14257:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584502528 00000100:00100000:3.0:1705683932.407835:0:14257:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407835:0:14257:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.407836:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1268, 88 off94600 00000100:00100000:3.0:1705683932.407837:0:14257:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59891 00000004:00080000:2.0:1705683932.407838:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469770038ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407839:0:14257:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:14418:x1788538584502528:12345-0@lo:1000:mdt00_024.0 00000040:00080000:2.0:1705683932.407844:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5290, 88 off382552 00000004:00080000:2.0:1705683932.407845:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469777031ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407853:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1269, 88 off94688 00000004:00080000:2.0:1705683932.407855:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469786851ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407861:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5291, 88 off382640 00000004:00080000:2.0:1705683932.407862:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469794181ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407864:0:14257:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14418:x1788538584502528:12345-0@lo:1000:mdt00_024.0 Request processed in 25us (54us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.407866:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1270, 88 off94776 00000004:00080000:2.0:1705683932.407867:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469799833ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407867:0:14257:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59891 00000040:00080000:2.0:1705683932.407873:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5292, 88 off382728 00000004:00080000:2.0:1705683932.407874:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469806474ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407879:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1271, 88 off94864 00000004:00080000:2.0:1705683932.407880:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469812724ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407886:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5293, 88 off382816 00000004:00080000:2.0:1705683932.407887:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469819179ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407891:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1272, 88 off94952 00000004:00080000:2.0:1705683932.407892:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469824123ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407897:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5294, 88 off382904 00000004:00080000:2.0:1705683932.407898:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469830476ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407902:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1273, 88 off95040 00000004:00080000:2.0:1705683932.407903:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469835209ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407908:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5295, 88 off382992 00000004:00080000:2.0:1705683932.407909:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469841541ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407913:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1274, 88 off95128 00000100:00100000:3.0:1705683932.407913:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3238:3084:x1788538584498752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7298us (7335us total) trans 4295348236 rc 0/0 00000004:00080000:2.0:1705683932.407914:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469846223ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407918:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920705 00000040:00080000:2.0:1705683932.407919:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5296, 88 off383080 00000004:00080000:2.0:1705683932.407920:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469852501ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407924:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1275, 88 off95216 00000004:00080000:2.0:1705683932.407925:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469857061ns, next at 706187302248ns, rc = 0 00000004:00080000:3.0:1705683932.407929:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099f09e00/2, rc 0, transno 380940 00000040:00080000:2.0:1705683932.407930:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5297, 88 off383168 00000004:00080000:2.0:1705683932.407931:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469863356ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407931:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584498752:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.407935:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1276, 88 off95304 00000004:00080000:2.0:1705683932.407936:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469867924ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407941:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5298, 88 off383256 00000004:00080000:2.0:1705683932.407942:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469874151ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407945:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1277, 88 off95392 00000004:00080000:2.0:1705683932.407947:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469878864ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407951:0:8813:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407951:0:8813:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.407953:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5299, 88 off383344 00000004:00080000:2.0:1705683932.407954:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469886474ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.407954:0:8813:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584502592 00000040:00080000:2.0:1705683932.407958:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1278, 88 off95480 00000004:00080000:2.0:1705683932.407959:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469891306ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.407961:0:8813:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407961:0:8813:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.407962:0:8813:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59892 00000040:00080000:2.0:1705683932.407964:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5300, 88 off383432 00000100:00100000:3.0:1705683932.407964:0:8813:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14418:x1788538584502592:12345-0@lo:1000:mdt00_024.0 00000004:00080000:2.0:1705683932.407965:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469897634ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407970:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1279, 88 off95568 00000004:00080000:2.0:1705683932.407971:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469903768ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407977:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5301, 88 off383520 00000004:00080000:2.0:1705683932.407978:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469910073ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407986:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1280, 88 off95656 00000004:00080000:2.0:1705683932.407987:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469919776ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.407993:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5302, 88 off383608 00000004:00080000:2.0:1705683932.407994:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469926736ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.407999:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1281, 88 off95744 00000004:00080000:2.0:1705683932.408000:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469932739ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408006:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5303, 88 off383696 00000004:00080000:2.0:1705683932.408007:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469939373ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408012:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1282, 88 off95832 00000004:00080000:2.0:1705683932.408013:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469945551ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408015:0:8813:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14418:x1788538584502592:12345-0@lo:1000:mdt00_024.0 Request processed in 50us (80us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.408019:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5304, 88 off383784 00000100:00100000:3.0:1705683932.408019:0:8813:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59892 00000004:00080000:2.0:1705683932.408020:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469951951ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408024:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1283, 88 off95920 00000004:00080000:2.0:1705683932.408026:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469957899ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408029:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408030:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.408031:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5305, 88 off383872 00000004:00080000:2.0:1705683932.408032:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469964179ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408032:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584502656 00000040:00080000:2.0:1705683932.408036:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1284, 88 off96008 00000004:00080000:2.0:1705683932.408037:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469969096ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408037:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408038:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408039:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920735 00000100:00100000:3.0:1705683932.408040:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3238:3083:x1788538584502656:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408042:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5306, 88 off383960 00000004:00080000:2.0:1705683932.408043:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469975747ns, next at 706174782226ns, rc = 0 00002000:00080000:3.0:1705683932.408046:0:15135:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34512 count 1 00000040:00080000:2.0:1705683932.408047:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1285, 88 off96096 00000004:00080000:2.0:1705683932.408048:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469980599ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408053:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5307, 88 off384048 00000004:00080000:2.0:1705683932.408055:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469987011ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408058:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1286, 88 off96184 00000004:00080000:2.0:1705683932.408059:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705469991764ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408065:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5308, 88 off384136 00000004:00080000:2.0:1705683932.408066:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705469998026ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408069:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1287, 88 off96272 00000004:00080000:2.0:1705683932.408070:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470002769ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408075:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5309, 88 off384224 00000004:00080000:2.0:1705683932.408090:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470022099ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408095:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1288, 88 off96360 00000004:00080000:2.0:1705683932.408097:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470028886ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408103:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5310, 88 off384312 00000004:00080000:2.0:1705683932.408104:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470036577ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408108:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1289, 88 off96448 00000004:00080000:2.0:1705683932.408109:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470041637ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408115:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5311, 88 off384400 00000004:00080000:2.0:1705683932.408116:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470048474ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408120:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1290, 88 off96536 00000004:00080000:2.0:1705683932.408121:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470053696ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408127:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5312, 88 off384488 00000004:00080000:2.0:1705683932.408128:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470060287ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408132:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1291, 88 off96624 00000004:00080000:2.0:1705683932.408133:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470064966ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408138:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5313, 88 off384576 00000004:00080000:2.0:1705683932.408140:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470072021ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408141:0:15135:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408143:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1292, 88 off96712 00000004:00080000:2.0:1705683932.408145:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470077074ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408146:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f700/0xefc4487a01806eaf lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1db8 expref: 4015 pid: 15173 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.408149:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe300/0xefc4487a0185a000 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ba7 expref: 5973 pid: 15175 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.408150:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5314, 88 off384664 00000004:00080000:2.0:1705683932.408151:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470083334ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408153:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.408153:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.408154:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408155:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1293, 88 off96800 00000004:00080000:2.0:1705683932.408156:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470088084ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408161:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5315, 88 off384752 00000004:00080000:2.0:1705683932.408162:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470094289ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408162:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe300/0xefc4487a0185a000 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ba7 expref: 5974 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.408165:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dfbe300/0xefc4487a0185a000 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ba7 expref: 5974 pid: 15175 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.408166:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1294, 88 off96888 00000004:00080000:2.0:1705683932.408167:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470098929ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408169:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584502720:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.408172:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5316, 88 off384840 00000004:00080000:2.0:1705683932.408173:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470105299ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408177:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1295, 88 off96976 00000004:00080000:2.0:1705683932.408178:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470109911ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408180:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f700/0xefc4487a01806eaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1db8 expref: 4015 pid: 15173 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.408183:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5317, 88 off384928 00010000:00010000:3.0:1705683932.408183:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5f700/0xefc4487a01806eaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1db8 expref: 4015 pid: 15173 timeout: 805 lvb_type: 1 00000004:00080000:2.0:1705683932.408184:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470116236ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408186:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584502784:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.408188:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1296, 88 off97064 00000004:00080000:2.0:1705683932.408189:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470120924ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408190:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2bae40 going to sleep for 11 seconds 00000040:00080000:2.0:1705683932.408214:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5319, 88 off385112 00000004:00080000:2.0:1705683932.408217:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470148826ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408223:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1297, 88 off97152 00000004:00080000:2.0:1705683932.408224:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470156579ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408230:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5320, 88 off385200 00000004:00080000:2.0:1705683932.408232:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470164014ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408235:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1298, 88 off97240 00000004:00080000:2.0:1705683932.408237:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470169539ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408242:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5321, 88 off385288 00000004:00080000:2.0:1705683932.408243:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470175726ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408247:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1299, 88 off97328 00000004:00080000:2.0:1705683932.408248:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470180564ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408253:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5322, 88 off385376 00000004:00080000:2.0:1705683932.408254:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470186081ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408257:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1300, 88 off97416 00000004:00080000:2.0:1705683932.408258:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470190754ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408263:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5323, 88 off385464 00000004:00080000:2.0:1705683932.408264:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470196241ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408268:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1301, 88 off97504 00000004:00080000:2.0:1705683932.408269:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470201191ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408273:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5324, 88 off385552 00000004:00080000:2.0:1705683932.408274:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470206474ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408278:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1302, 88 off97592 00000004:00080000:2.0:1705683932.408279:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470211146ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408283:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5325, 88 off385640 00000004:00080000:3.0:1705683932.408284:0:7795:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88009266a000 version 15023 rpc_version 15023 00000004:00080000:2.0:1705683932.408285:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470216867ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408288:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1303, 88 off97680 00000004:00080000:2.0:1705683932.408289:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470221434ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408293:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5326, 88 off385728 00000020:00100000:3.0:1705683932.408293:0:7795:0:(genops.c:2249:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000004:00080000:2.0:1705683932.408294:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470226094ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408295:0:7795:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097efee00 x1788538584502912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2080/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1705683932.408301:0:7795:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efee00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1788538584502912:0@lo:1000:osp_up1-0.0 00000040:00080000:2.0:1705683932.408304:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1304, 88 off97768 00000004:00080000:2.0:1705683932.408305:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470237606ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408309:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5327, 88 off385816 00000004:00080000:2.0:1705683932.408310:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470242467ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408311:0:7795:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.408315:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1305, 88 off97856 00000100:00100000:3.0:1705683932.408318:0:7795:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.408322:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408323:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.408324:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1705683932.408325:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584502912 00010000:00010000:2.0:1705683932.408326:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d561680/0xefc4487a01878721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.408330:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d561680 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.408331:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d561680/0xefc4487a01878721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.408332:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408332:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:2.0:1705683932.408334:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d561680/0xefc4487a01878721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.408334:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59893 00000100:00100000:3.0:1705683932.408335:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:7795:x1788538584502912:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1705683932.408339:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d561680/0xefc4487a01878721 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.408342:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d561680/0xefc4487a01878721 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.408356:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.408356:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.408357:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1705683932.408358:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470290624ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408366:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5328, 88 off385904 00000004:00080000:2.0:1705683932.408367:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470299599ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408373:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1306, 88 off97944 00000004:00080000:2.0:1705683932.408374:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470306279ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408378:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5329, 88 off385992 00000004:00080000:2.0:1705683932.408379:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470311356ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408384:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1307, 88 off98032 00000004:00080000:2.0:1705683932.408386:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470318004ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408389:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5330, 88 off386080 00000004:00080000:2.0:1705683932.408391:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470322859ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408395:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1308, 88 off98120 00000004:00080000:2.0:1705683932.408396:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470328321ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408400:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5331, 88 off386168 00000004:00080000:2.0:1705683932.408401:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470333029ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408405:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1309, 88 off98208 00000004:00080000:2.0:1705683932.408406:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470338374ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408410:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5332, 88 off386256 00000004:00080000:2.0:1705683932.408411:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470342971ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408426:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:7795:x1788538584502912:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (114us total) trans 4295084955 rc 0/0 00000100:00100000:3.0:1705683932.408429:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59893 00000040:00080000:2.0:1705683932.408440:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1311, 88 off98392 00000004:00080000:2.0:1705683932.408442:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470374499ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408448:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5333, 88 off386344 00000004:00080000:2.0:1705683932.408450:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470382654ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408452:0:7795:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efee00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1788538584502912:0@lo:1000:osp_up1-0.0 00000040:00080000:2.0:1705683932.408456:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1312, 88 off98480 00000004:00080000:2.0:1705683932.408457:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470389519ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408462:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5334, 88 off386432 00000004:00080000:2.0:1705683932.408463:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470395841ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.408463:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3e400/2, rc 0, transno 380941 00000100:00100000:3.0:1705683932.408464:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099e3e400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584500288:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408467:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1313, 88 off98568 00000004:00080000:2.0:1705683932.408468:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470400836ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408479:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5335, 88 off386520 00000004:00080000:2.0:1705683932.408480:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470412710ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408485:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1314, 88 off98656 00000004:00080000:2.0:1705683932.408486:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470418255ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408491:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5336, 88 off386608 00000004:00080000:2.0:1705683932.408492:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470424594ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408496:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1315, 88 off98744 00000004:00080000:2.0:1705683932.408497:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470429665ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408502:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5337, 88 off386696 00000004:00080000:2.0:1705683932.408503:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470435574ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408507:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1316, 88 off98832 00000004:00080000:2.0:1705683932.408508:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470440407ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408513:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5338, 88 off386784 00000004:00080000:2.0:1705683932.408514:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470445966ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408517:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1317, 88 off98920 00000004:00080000:2.0:1705683932.408518:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470450610ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408523:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5339, 88 off386872 00000004:00080000:2.0:1705683932.408524:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470455984ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408527:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1318, 88 off99008 00000004:00080000:2.0:1705683932.408528:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470460596ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408533:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5340, 88 off386960 00000004:00080000:2.0:1705683932.408534:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470465994ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408537:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1319, 88 off99096 00000004:00080000:2.0:1705683932.408538:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470470556ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408543:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5341, 88 off387048 00000004:00080000:2.0:1705683932.408544:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470475919ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408545:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.408546:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408547:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1320, 88 off99184 00000004:00080000:2.0:1705683932.408548:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470480679ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408549:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0d44a00 already unused, calling callback (ffffffffa0d76510) 00010000:00010000:3.0:1705683932.408551:0:15119:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408553:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5342, 88 off387136 00000004:00080000:2.0:1705683932.408554:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470486751ns, next at 706174782226ns, rc = 0 00000004:00010000:3.0:1705683932.408554:0:15119:0:(mdt_handler.c:3677:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408558:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1321, 88 off99272 00000004:00080000:2.0:1705683932.408559:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470491359ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408563:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5343, 88 off387224 00000004:00080000:2.0:1705683932.408564:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470496237ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408564:0:15119:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408567:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1322, 88 off99360 00000004:00080000:2.0:1705683932.408568:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470500797ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408568:0:15119:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000040:00080000:2.0:1705683932.408572:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5344, 88 off387312 00000004:00080000:2.0:1705683932.408573:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470505704ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408574:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.408576:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a0d44a00/0xefc4487a01878584 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a0187858b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408577:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1323, 88 off99448 00000004:00080000:2.0:1705683932.408578:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470510337ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408582:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5345, 88 off387400 00000004:00080000:2.0:1705683932.408583:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470514934ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408583:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.408584:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.408584:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.408586:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1324, 88 off99536 00000004:00080000:2.0:1705683932.408587:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470519495ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408587:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efa800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3081:1788538584503040:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1705683932.408591:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5346, 88 off387488 00000004:00080000:2.0:1705683932.408592:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470523929ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408595:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1325, 88 off99624 00000004:00080000:2.0:1705683932.408596:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470528384ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408598:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.408600:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5347, 88 off387576 00000004:00080000:2.0:1705683932.408601:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470533081ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408604:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1326, 88 off99712 00000004:00080000:2.0:1705683932.408605:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470537655ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408609:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5348, 88 off387664 00000004:00080000:2.0:1705683932.408610:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470542294ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408610:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1705683932.408613:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584503104:0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408619:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1327, 88 off99800 00000100:00100000:3.0:1705683932.408619:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.408620:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470552556ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408624:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5349, 88 off387752 00000004:00080000:2.0:1705683932.408625:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470557490ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408629:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1328, 88 off99888 00000100:00100000:3.0:1705683932.408629:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408629:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.408630:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470562456ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408632:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584503104 00000040:00080000:2.0:1705683932.408638:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5350, 88 off387840 00000004:00080000:2.0:1705683932.408639:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470571675ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408641:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408642:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.408643:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1329, 88 off99976 00000100:00100000:3.0:1705683932.408644:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920737 00000004:00080000:2.0:1705683932.408645:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470577184ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408645:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3239:3081:x1788538584503104:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408652:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5351, 88 off387928 00000004:00080000:2.0:1705683932.408654:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470585880ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408661:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1330, 88 off100064 00000004:00080000:2.0:1705683932.408663:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470594900ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408670:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5352, 88 off388016 00000004:00080000:2.0:1705683932.408672:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470603991ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408679:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1331, 88 off100152 00000004:00080000:2.0:1705683932.408681:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470613070ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408688:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5353, 88 off388104 00002000:00010000:3.0:1705683932.408689:0:15215:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95d8:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1705683932.408690:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470622251ns, next at 706174782226ns, rc = 0 00002000:00010000:3.0:1705683932.408690:0:15215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95d8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.408691:0:15215:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95d8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.408692:0:15215:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95d8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.408692:0:15215:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95d8:0x0] updating lvb blocks from disk: 0 -> 0 00000040:00080000:2.0:1705683932.408698:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1332, 88 off100240 00000004:00080000:2.0:1705683932.408700:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470631987ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408705:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5354, 88 off388192 00000004:00080000:2.0:1705683932.408706:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470638280ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408706:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efa800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3081:1788538584503040:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1705683932.408722:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1333, 88 off100328 00000004:00080000:2.0:1705683932.408724:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470655921ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408728:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5355, 88 off388280 00000004:00080000:2.0:1705683932.408729:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470661441ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408737:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1334, 88 off100416 00000100:00100000:3.0:1705683932.408737:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3240:3081:x1788538584503104:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (117us total) trans 4295348238 rc 0/0 00000004:00080000:2.0:1705683932.408739:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470670876ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408740:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920737 00000040:00080000:2.0:1705683932.408744:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5356, 88 off388368 00000004:00080000:2.0:1705683932.408745:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470677591ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.408749:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3ad00/2, rc 0, transno 380942 00000100:00100000:3.0:1705683932.408750:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099e3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584503104:0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408753:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1335, 88 off100504 00000004:00080000:2.0:1705683932.408755:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470686975ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408760:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5357, 88 off388456 00000004:00080000:2.0:1705683932.408761:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470693550ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408764:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.408766:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3b700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584503168:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408767:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1336, 88 off100592 00000004:00080000:2.0:1705683932.408769:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470700930ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408774:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5358, 88 off388544 00000004:00080000:2.0:1705683932.408775:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470707084ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.408775:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.408783:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1337, 88 off100680 00000100:00100000:3.0:1705683932.408783:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408783:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.408784:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470716417ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.408785:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584503168 00000100:00100000:3.0:1705683932.408794:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408795:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.408796:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920738 00000100:00100000:3.0:1705683932.408797:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3240:3084:x1788538584503168:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.408803:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5360, 88 off388696 00002000:00080000:3.0:1705683932.408803:0:15215:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34513 count 1 00000004:00080000:2.0:1705683932.408804:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470736817ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408812:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1338, 88 off100768 00000004:00080000:2.0:1705683932.408814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470746146ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408821:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5361, 88 off388784 00000004:00080000:2.0:1705683932.408823:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470755136ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408831:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1339, 88 off100856 00000004:00080000:2.0:1705683932.408832:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470764630ns, next at 706187302248ns, rc = 0 00010000:00010000:2.0:1705683932.408844:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.408845:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a633b700/0xefc4487a01878839 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x41ce:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14233 initiator: MDT1 00010000:00010000:2.0:1705683932.408850:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a633b700 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.408851:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a633b700/0xefc4487a01878839 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x41ce:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 14233 initiator: MDT1 00010000:00010000:2.0:1705683932.408853:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a633b700/0xefc4487a01878839 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x41ce:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 14233 initiator: MDT1 00010000:00010000:2.0:1705683932.408862:0:6522:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ce:0x0].0x0 (ffff88009e2d2100) 00010000:00010000:2.0:1705683932.408863:0:6522:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1705683932.408864:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a633b700/0xefc4487a01878839 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x41ce:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 14233 initiator: MDT1 00010000:00010000:2.0:1705683932.408866:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a633b700/0xefc4487a01878839 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x41ce:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14233 initiator: MDT1 00010000:00010000:2.0:1705683932.408871:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.408871:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.408872:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.408876:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5362, 88 off388872 00000004:00080000:2.0:1705683932.408877:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470809659ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408881:0:15215:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408888:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1340, 88 off100944 00000004:00080000:2.0:1705683932.408889:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470821640ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408889:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123c58780/0xefc4487a01806ed2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ddb expref: 4013 pid: 15141 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.408896:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c65e00/0xefc4487a0185a007 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bb5 expref: 5972 pid: 15118 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.408898:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5363, 88 off388960 00000004:00080000:2.0:1705683932.408899:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470831335ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408900:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.408901:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.408902:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.408907:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1341, 88 off101032 00000004:00080000:2.0:1705683932.408908:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470840574ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408916:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5364, 88 off389048 00000004:00080000:2.0:1705683932.408917:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470849539ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408921:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1342, 88 off101120 00010000:00010000:3.0:1705683932.408921:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c65e00/0xefc4487a0185a007 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bb5 expref: 5972 pid: 15118 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.408922:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470854740ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.408928:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c65e00/0xefc4487a0185a007 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bb5 expref: 5972 pid: 15118 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.408934:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584503232:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.408952:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5365, 88 off389136 00000004:00080000:2.0:1705683932.408954:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470886426ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.408954:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123c58780/0xefc4487a01806ed2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ddb expref: 4013 pid: 15141 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.408958:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123c58780/0xefc4487a01806ed2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ddb expref: 4013 pid: 15141 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.408962:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584503296:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.408967:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1343, 88 off101208 00000100:00100000:3.0:1705683932.408967:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1705683932.408968:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470900345ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408976:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5366, 88 off389224 00000004:00080000:2.0:1705683932.408978:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470910277ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408983:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1344, 88 off101296 00000004:00080000:2.0:1705683932.408984:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470916806ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.408989:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5367, 88 off389312 00000004:00080000:2.0:1705683932.408991:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470922997ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.408995:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1345, 88 off101384 00000004:00080000:2.0:1705683932.408997:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470929020ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409001:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5368, 88 off389400 00000004:00080000:2.0:1705683932.409003:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470934947ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409007:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1346, 88 off101472 00000004:00080000:2.0:1705683932.409009:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470940857ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409013:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5369, 88 off389488 00000004:00080000:2.0:1705683932.409015:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470946961ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409019:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1347, 88 off101560 00000004:00080000:2.0:1705683932.409021:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470952914ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409025:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5370, 88 off389576 00000004:00080000:2.0:1705683932.409026:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470958735ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409031:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1348, 88 off101648 00000004:00080000:2.0:1705683932.409033:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470964910ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409037:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5371, 88 off389664 00000004:00080000:2.0:1705683932.409038:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470970734ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409043:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1349, 88 off101736 00000004:00080000:2.0:1705683932.409044:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470976237ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409048:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5372, 88 off389752 00000004:00080000:2.0:1705683932.409049:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470981735ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409054:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1350, 88 off101824 00000004:00080000:2.0:1705683932.409055:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470987337ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409060:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5373, 88 off389840 00000004:00080000:2.0:1705683932.409061:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705470993257ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409066:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1351, 88 off101912 00000004:00080000:2.0:1705683932.409067:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705470999294ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409072:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5374, 88 off389928 00000004:00080000:2.0:1705683932.409073:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471005089ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409091:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1352, 88 off102000 00000004:00080000:2.0:1705683932.409093:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471025095ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409099:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5375, 88 off390016 00000004:00080000:2.0:1705683932.409100:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471032226ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409105:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1353, 88 off102088 00000004:00080000:2.0:1705683932.409106:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471038077ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409111:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5376, 88 off390104 00000004:00080000:2.0:1705683932.409112:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471044177ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409116:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1354, 88 off102176 00000004:00080000:2.0:1705683932.409117:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471049761ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409122:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5377, 88 off390192 00000004:00080000:2.0:1705683932.409123:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471055511ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409128:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1355, 88 off102264 00000004:00080000:2.0:1705683932.409129:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471061396ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409134:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5378, 88 off390280 00000004:00080000:2.0:1705683932.409135:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471067045ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409139:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1356, 88 off102352 00000004:00080000:2.0:1705683932.409140:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471072669ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409145:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5379, 88 off390368 00000004:00080000:2.0:1705683932.409146:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471078236ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409169:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1357, 88 off102440 00000004:00080000:2.0:1705683932.409171:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471103250ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409179:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5380, 88 off390456 00000004:00080000:2.0:1705683932.409180:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471112194ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409186:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1358, 88 off102528 00000004:00080000:2.0:1705683932.409187:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471119084ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409192:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5381, 88 off390544 00000004:00080000:2.0:1705683932.409193:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471125214ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409198:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1359, 88 off102616 00000004:00080000:2.0:1705683932.409199:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471131246ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409204:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5382, 88 off390632 00000004:00080000:2.0:1705683932.409205:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471137165ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409210:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1360, 88 off102704 00000004:00080000:2.0:1705683932.409211:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471142990ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409216:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5383, 88 off390720 00000004:00080000:2.0:1705683932.409217:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471149045ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409221:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1361, 88 off102792 00000004:00080000:2.0:1705683932.409222:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471154561ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409227:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5384, 88 off390808 00000004:00080000:2.0:1705683932.409228:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471159915ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409232:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1362, 88 off102880 00000004:00080000:2.0:1705683932.409233:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471165530ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409238:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5385, 88 off390896 00000004:00080000:2.0:1705683932.409239:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471171155ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409243:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1363, 88 off102968 00000004:00080000:2.0:1705683932.409244:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471176545ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409249:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5386, 88 off390984 00000004:00080000:2.0:1705683932.409250:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471182005ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409255:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1364, 88 off103056 00000004:00080000:2.0:1705683932.409256:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471188009ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409260:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5387, 88 off391072 00000004:00080000:2.0:1705683932.409261:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471193666ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409266:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1365, 88 off103144 00000004:00080000:2.0:1705683932.409267:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471199225ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409271:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5388, 88 off391160 00000004:00080000:2.0:1705683932.409272:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471204720ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409277:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1366, 88 off103232 00000004:00080000:2.0:1705683932.409278:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471210294ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409282:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5389, 88 off391248 00000004:00080000:2.0:1705683932.409283:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471215724ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409288:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1367, 88 off103320 00000004:00080000:2.0:1705683932.409289:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471221825ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409294:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5390, 88 off391336 00000004:00080000:2.0:1705683932.409295:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471227827ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409300:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1368, 88 off103408 00000004:00080000:2.0:1705683932.409301:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471233682ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409306:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5391, 88 off391424 00000004:00080000:2.0:1705683932.409307:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471239382ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409312:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1369, 88 off103496 00000004:00080000:2.0:1705683932.409313:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471245395ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409318:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5392, 88 off391512 00000004:00080000:2.0:1705683932.409319:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471250994ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409323:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1370, 88 off103584 00000004:00080000:2.0:1705683932.409324:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471256664ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409329:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5393, 88 off391600 00000004:00080000:2.0:1705683932.409330:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471262540ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409335:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1371, 88 off103672 00000004:00080000:2.0:1705683932.409336:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471268577ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409341:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5394, 88 off391688 00000004:00080000:2.0:1705683932.409342:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471273929ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409346:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1372, 88 off103760 00000004:00080000:2.0:1705683932.409347:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471279274ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409351:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5395, 88 off391776 00000004:00080000:2.0:1705683932.409352:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471284712ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409357:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1373, 88 off103848 00000004:00080000:2.0:1705683932.409358:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471290107ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409362:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5396, 88 off391864 00000004:00080000:2.0:1705683932.409363:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471295405ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409367:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1374, 88 off103936 00000004:00080000:2.0:1705683932.409369:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471300899ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409373:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5397, 88 off391952 00000004:00080000:2.0:1705683932.409374:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471306252ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409379:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1375, 88 off104024 00000004:00080000:2.0:1705683932.409380:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471311960ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409384:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5398, 88 off392040 00000004:00080000:2.0:1705683932.409385:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471317454ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409390:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1376, 88 off104112 00000004:00080000:2.0:1705683932.409391:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471323194ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409395:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5399, 88 off392128 00000004:00080000:2.0:1705683932.409396:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471328634ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409401:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1377, 88 off104200 00000004:00080000:2.0:1705683932.409402:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471334039ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409407:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5400, 88 off392216 00000004:00080000:2.0:1705683932.409408:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471339942ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409412:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1378, 88 off104288 00000004:00080000:2.0:1705683932.409413:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471345784ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409418:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5401, 88 off392304 00000004:00080000:2.0:1705683932.409419:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471351295ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409423:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1379, 88 off104376 00000004:00080000:2.0:1705683932.409424:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471356682ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409429:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5402, 88 off392392 00000004:00080000:2.0:1705683932.409430:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471362424ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409435:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1380, 88 off104464 00000004:00080000:2.0:1705683932.409436:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471367914ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409440:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5403, 88 off392480 00000004:00080000:2.0:1705683932.409441:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471373449ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409445:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1381, 88 off104552 00000004:00080000:2.0:1705683932.409446:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471378777ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409451:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5404, 88 off392568 00000004:00080000:2.0:1705683932.409452:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471384260ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409456:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1382, 88 off104640 00000004:00080000:2.0:1705683932.409457:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471389715ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409462:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5405, 88 off392656 00000004:00080000:2.0:1705683932.409463:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471395194ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409467:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1383, 88 off104728 00000004:00080000:2.0:1705683932.409468:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471400630ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409473:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5406, 88 off392744 00000004:00080000:2.0:1705683932.409474:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471406097ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409478:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1384, 88 off104816 00000004:00080000:2.0:1705683932.409479:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471411755ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409484:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5407, 88 off392832 00000004:00080000:2.0:1705683932.409485:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471417204ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409489:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1385, 88 off104904 00000004:00080000:2.0:1705683932.409490:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471422579ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409494:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5408, 88 off392920 00000004:00080000:2.0:1705683932.409495:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471427085ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409499:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1386, 88 off104992 00000004:00080000:2.0:1705683932.409500:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471432599ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409504:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5409, 88 off393008 00000004:00080000:2.0:1705683932.409505:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471437215ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409509:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1387, 88 off105080 00000004:00080000:2.0:1705683932.409510:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471442672ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409514:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5410, 88 off393096 00000004:00080000:2.0:1705683932.409515:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471447489ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409520:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1388, 88 off105168 00000004:00080000:2.0:1705683932.409521:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471453100ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409524:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5411, 88 off393184 00000004:00080000:2.0:1705683932.409526:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471457964ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409531:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1389, 88 off105256 00000004:00080000:2.0:1705683932.409532:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471464187ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409555:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5413, 88 off393304 00000004:00080000:2.0:1705683932.409557:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471489747ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409565:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1390, 88 off105344 00000004:00080000:2.0:1705683932.409566:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471498329ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409571:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5414, 88 off393392 00000004:00080000:2.0:1705683932.409572:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471504662ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409578:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1391, 88 off105432 00000004:00080000:2.0:1705683932.409579:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471511267ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409584:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5415, 88 off393480 00000004:00080000:2.0:1705683932.409585:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471517037ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409589:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1392, 88 off105520 00000004:00080000:2.0:1705683932.409590:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471522669ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409595:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5416, 88 off393568 00000004:00080000:2.0:1705683932.409596:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471528065ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409600:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1393, 88 off105608 00000004:00080000:2.0:1705683932.409601:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471533497ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409605:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5417, 88 off393656 00000004:00080000:2.0:1705683932.409606:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471538824ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409611:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1394, 88 off105696 00000004:00080000:2.0:1705683932.409612:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471544425ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409616:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5418, 88 off393744 00000004:00080000:2.0:1705683932.409617:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471549687ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409622:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1395, 88 off105784 00000004:00080000:2.0:1705683932.409623:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471555037ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409627:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5419, 88 off393832 00000004:00080000:2.0:1705683932.409628:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471560397ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409632:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1396, 88 off105872 00000004:00080000:2.0:1705683932.409633:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471565674ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409638:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5420, 88 off393920 00000004:00080000:2.0:1705683932.409639:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471570947ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409643:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1397, 88 off105960 00000004:00080000:2.0:1705683932.409644:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471576217ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409647:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5421, 88 off394008 00000004:00080000:2.0:1705683932.409649:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471580960ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409653:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1398, 88 off106048 00000004:00080000:2.0:1705683932.409654:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471586467ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409658:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5422, 88 off394096 00000004:00080000:2.0:1705683932.409659:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471591050ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409663:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1399, 88 off106136 00000004:00080000:2.0:1705683932.409664:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471596382ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409668:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5423, 88 off394184 00000004:00080000:2.0:1705683932.409669:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471600849ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409673:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1400, 88 off106224 00000004:00080000:2.0:1705683932.409674:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471606149ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409677:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5424, 88 off394272 00000004:00080000:2.0:1705683932.409678:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471610664ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409683:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1401, 88 off106312 00000004:00080000:2.0:1705683932.409684:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471615929ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409687:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5425, 88 off394360 00000004:00080000:2.0:1705683932.409688:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471620394ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409693:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1402, 88 off106400 00000004:00080000:2.0:1705683932.409694:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471625938ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409697:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5426, 88 off394448 00000004:00080000:2.0:1705683932.409698:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471630530ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409731:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1404, 88 off106584 00000004:00080000:2.0:1705683932.409733:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471665377ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.409738:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073781e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3241:10725:x1788538584494720:12345-0@lo:5:osp-pre-1-1.0 Request processed in 14233us (14361us total) trans 4295348239 rc 0/0 00000100:00100000:3.0:1705683932.409741:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920674 00000040:00080000:2.0:1705683932.409742:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5427, 88 off394536 00000004:00080000:2.0:1705683932.409743:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471675494ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409749:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1405, 88 off106672 00000004:00080000:2.0:1705683932.409751:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471683230ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409759:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5428, 88 off394624 00000004:00080000:2.0:1705683932.409761:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471693490ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409769:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1406, 88 off106760 00000004:00080000:2.0:1705683932.409772:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471703875ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409780:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5429, 88 off394712 00000004:00080000:2.0:1705683932.409782:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471714224ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409791:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1407, 88 off106848 00000004:00080000:2.0:1705683932.409793:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471725155ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409801:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5430, 88 off394800 00000004:00080000:2.0:1705683932.409803:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471735604ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409812:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1408, 88 off106936 00000004:00080000:2.0:1705683932.409814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471745994ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.409814:0:10725:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073782d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10725:1788538584494720:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1705683932.409819:0:10725:0:(osp_precreate.c:718:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000402:0x9cfa:0x0]-[0x2c0000402:0x9d81:0x0] 00000040:00080000:2.0:1705683932.409823:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5431, 88 off394888 00000004:00080000:2.0:1705683932.409825:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471756959ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.409830:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090132800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584500608:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.409832:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1409, 88 off107024 00000004:00080000:2.0:1705683932.409834:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471766758ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.409834:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090135000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584500672:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.409839:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5432, 88 off394976 00000004:00080000:2.0:1705683932.409841:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471773020ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.409842:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.409845:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1410, 88 off107112 00010000:00100000:3.0:1705683932.409845:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.409846:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.409846:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.409847:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471778915ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409852:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5433, 88 off395064 00000100:00100000:3.0:1705683932.409852:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584501120:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.409853:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471785579ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409859:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1411, 88 off107200 00000004:00080000:2.0:1705683932.409860:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471792219ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409865:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5434, 88 off395152 00000004:00080000:2.0:1705683932.409866:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471798112ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409871:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1412, 88 off107288 00000004:00080000:2.0:1705683932.409873:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471804968ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409878:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5435, 88 off395240 00000004:00080000:2.0:1705683932.409880:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471811968ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409885:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1413, 88 off107376 00000004:00080000:2.0:1705683932.409886:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471818718ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409896:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5436, 88 off395328 00000004:00080000:2.0:1705683932.409897:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471829359ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409902:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1414, 88 off107464 00000004:00080000:2.0:1705683932.409903:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471835677ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409908:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5437, 88 off395416 00000004:00080000:2.0:1705683932.409909:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471841662ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409915:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1415, 88 off107552 00000004:00080000:2.0:1705683932.409916:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471848648ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409922:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5438, 88 off395504 00000004:00080000:2.0:1705683932.409923:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471855295ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409931:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1416, 88 off107640 00000004:00080000:2.0:1705683932.409932:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471864527ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409937:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5439, 88 off395592 00000004:00080000:2.0:1705683932.409938:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471870524ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409943:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1417, 88 off107728 00000004:00080000:2.0:1705683932.409944:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471876474ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409949:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5440, 88 off395680 00000004:00080000:2.0:1705683932.409950:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471882840ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409955:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1418, 88 off107816 00000004:00080000:2.0:1705683932.409956:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471888475ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409961:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5441, 88 off395768 00000004:00080000:2.0:1705683932.409962:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471894175ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409967:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1419, 88 off107904 00000004:00080000:2.0:1705683932.409968:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471900649ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409973:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5442, 88 off395856 00000004:00080000:2.0:1705683932.409974:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471906378ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409979:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1420, 88 off107992 00000004:00080000:2.0:1705683932.409980:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471912474ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409985:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5443, 88 off395944 00000004:00080000:2.0:1705683932.409986:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471918455ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.409991:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1421, 88 off108080 00000004:00080000:2.0:1705683932.409992:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471924235ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.409996:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5444, 88 off396032 00000004:00080000:2.0:1705683932.409998:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471929858ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410002:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1422, 88 off108168 00000004:00080000:2.0:1705683932.410003:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471935358ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410007:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5445, 88 off396120 00000004:00080000:2.0:1705683932.410009:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471940884ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410013:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1423, 88 off108256 00000004:00080000:2.0:1705683932.410015:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471947035ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410019:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5446, 88 off396208 00000004:00080000:2.0:1705683932.410020:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471952750ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410025:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1424, 88 off108344 00000004:00080000:2.0:1705683932.410026:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471958325ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410030:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5447, 88 off396296 00000004:00080000:2.0:1705683932.410031:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471963727ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410036:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1425, 88 off108432 00000004:00080000:2.0:1705683932.410037:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471969097ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410041:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5448, 88 off396384 00000004:00080000:2.0:1705683932.410043:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471974899ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410047:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1426, 88 off108520 00000004:00080000:2.0:1705683932.410048:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471980488ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410052:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5449, 88 off396472 00000004:00080000:2.0:1705683932.410053:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471985830ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410058:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1427, 88 off108608 00000004:00080000:2.0:1705683932.410059:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705471991220ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410063:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5450, 88 off396560 00000004:00080000:2.0:1705683932.410064:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705471996795ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410069:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1428, 88 off108696 00000004:00080000:2.0:1705683932.410070:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472002340ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410074:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5451, 88 off396648 00000004:00080000:2.0:1705683932.410075:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472007832ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410093:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1429, 88 off108784 00000004:00080000:2.0:1705683932.410095:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472027582ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410100:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5452, 88 off396736 00000004:00080000:2.0:1705683932.410101:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472033757ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410106:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1430, 88 off108872 00000004:00080000:2.0:1705683932.410107:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472039538ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410112:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5453, 88 off396824 00000004:00080000:2.0:1705683932.410113:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472045492ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410118:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1431, 88 off108960 00000004:00080000:2.0:1705683932.410119:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472051308ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410123:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5454, 88 off396912 00000004:00080000:2.0:1705683932.410124:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472056715ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410129:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1432, 88 off109048 00000004:00080000:2.0:1705683932.410130:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472062089ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410134:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5455, 88 off397000 00000004:00080000:2.0:1705683932.410136:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472067870ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410140:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1433, 88 off109136 00000004:00080000:2.0:1705683932.410142:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472073905ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410146:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5456, 88 off397088 00000004:00080000:2.0:1705683932.410147:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472079477ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410151:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1434, 88 off109224 00000004:00080000:2.0:1705683932.410153:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472084887ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410157:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5457, 88 off397176 00000004:00080000:2.0:1705683932.410158:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472090430ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410163:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1435, 88 off109312 00000004:00080000:2.0:1705683932.410164:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472095977ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410168:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5458, 88 off397264 00000004:00080000:2.0:1705683932.410169:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472101457ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410173:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1436, 88 off109400 00000004:00080000:2.0:1705683932.410175:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472106944ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410200:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5459, 88 off397352 00000004:00080000:2.0:1705683932.410202:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472134158ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410209:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1437, 88 off109488 00000004:00080000:2.0:1705683932.410210:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472142599ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410216:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5460, 88 off397440 00000004:00080000:2.0:1705683932.410217:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472149239ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410222:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1438, 88 off109576 00000004:00080000:2.0:1705683932.410223:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472155412ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410228:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5461, 88 off397528 00000004:00080000:2.0:1705683932.410229:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472161297ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410233:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1439, 88 off109664 00000004:00080000:2.0:1705683932.410235:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472167157ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410239:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5462, 88 off397616 00000004:00080000:2.0:1705683932.410241:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472172975ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410245:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1440, 88 off109752 00000004:00080000:2.0:1705683932.410246:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472178634ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410251:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5463, 88 off397704 00000004:00080000:2.0:1705683932.410252:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472184152ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410256:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1441, 88 off109840 00000004:00080000:2.0:1705683932.410257:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472189589ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410262:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5464, 88 off397792 00000004:00080000:2.0:1705683932.410263:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472195072ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410267:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1442, 88 off109928 00000004:00080000:2.0:1705683932.410268:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472200390ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410272:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5465, 88 off397880 00000004:00080000:2.0:1705683932.410273:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472205847ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410278:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1443, 88 off110016 00000004:00080000:2.0:1705683932.410279:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472211219ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410283:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5466, 88 off397968 00000004:00080000:2.0:1705683932.410284:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472216495ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410288:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1444, 88 off110104 00000004:00080000:2.0:1705683932.410289:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472221767ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410294:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5467, 88 off398056 00000004:00080000:2.0:1705683932.410295:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472227082ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410299:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1445, 88 off110192 00000004:00080000:2.0:1705683932.410300:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472232679ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410305:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5468, 88 off398144 00000004:00080000:2.0:1705683932.410306:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472238062ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410310:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1446, 88 off110280 00000004:00080000:2.0:1705683932.410311:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472243748ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410316:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5469, 88 off398232 00000004:00080000:2.0:1705683932.410317:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472249025ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410321:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1447, 88 off110368 00000004:00080000:2.0:1705683932.410322:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472254637ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410327:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5470, 88 off398320 00000004:00080000:2.0:1705683932.410328:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472259919ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410332:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1448, 88 off110456 00000004:00080000:2.0:1705683932.410333:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472265582ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410338:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5471, 88 off398408 00000004:00080000:2.0:1705683932.410339:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472271084ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410343:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1449, 88 off110544 00000004:00080000:2.0:1705683932.410344:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472276759ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410349:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5472, 88 off398496 00000004:00080000:2.0:1705683932.410350:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472282808ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410372:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1450, 88 off110632 00000004:00080000:2.0:1705683932.410374:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472306247ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410381:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5473, 88 off398584 00000004:00080000:2.0:1705683932.410382:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472314404ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410387:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1451, 88 off110720 00000004:00080000:2.0:1705683932.410388:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472320724ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410393:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5474, 88 off398672 00000004:00080000:2.0:1705683932.410394:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472326469ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410399:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1452, 88 off110808 00000004:00080000:2.0:1705683932.410400:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472332369ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410405:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5475, 88 off398760 00000004:00080000:2.0:1705683932.410406:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472338174ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410410:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1453, 88 off110896 00000004:00080000:2.0:1705683932.410412:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472343854ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410416:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5476, 88 off398848 00000004:00080000:2.0:1705683932.410417:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472349502ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410422:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1454, 88 off110984 00000004:00080000:2.0:1705683932.410423:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472354998ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410427:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5477, 88 off398936 00000004:00080000:2.0:1705683932.410428:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472360689ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410433:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1455, 88 off111072 00000004:00080000:2.0:1705683932.410434:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472366648ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410439:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5478, 88 off399024 00000004:00080000:2.0:1705683932.410440:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472372128ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410444:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1456, 88 off111160 00000004:00080000:2.0:1705683932.410445:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472377514ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410449:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5479, 88 off399112 00000004:00080000:2.0:1705683932.410450:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472382847ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410455:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1457, 88 off111248 00000004:00080000:2.0:1705683932.410456:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472388232ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410460:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5480, 88 off399200 00000004:00080000:2.0:1705683932.410461:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472393618ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410466:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1458, 88 off111336 00000004:00080000:2.0:1705683932.410467:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472398930ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410471:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5481, 88 off399288 00000004:00080000:2.0:1705683932.410472:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472404458ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410476:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1459, 88 off111424 00000004:00080000:2.0:1705683932.410477:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472409757ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410482:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5482, 88 off399376 00000004:00080000:2.0:1705683932.410483:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472415630ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410488:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1460, 88 off111512 00000004:00080000:2.0:1705683932.410489:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472421157ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410493:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5483, 88 off399464 00000004:00080000:2.0:1705683932.410494:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472426705ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410499:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1461, 88 off111600 00000004:00080000:2.0:1705683932.410500:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472432242ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410504:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5484, 88 off399552 00000004:00080000:2.0:1705683932.410505:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472437490ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410509:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1462, 88 off111688 00000004:00080000:2.0:1705683932.410510:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472442770ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410515:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5485, 88 off399640 00000004:00080000:2.0:1705683932.410516:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472448050ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410520:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1463, 88 off111776 00000004:00080000:2.0:1705683932.410521:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472453482ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410525:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5486, 88 off399728 00000004:00080000:2.0:1705683932.410527:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472458857ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410531:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1464, 88 off111864 00000004:00080000:2.0:1705683932.410532:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472464215ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410536:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5487, 88 off399816 00000004:00080000:2.0:1705683932.410537:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472469607ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410542:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1465, 88 off111952 00000004:00080000:2.0:1705683932.410543:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472474960ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410547:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5488, 88 off399904 00000004:00080000:2.0:1705683932.410548:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472480367ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410552:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1466, 88 off112040 00000004:00080000:2.0:1705683932.410554:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472485975ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410558:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5489, 88 off399992 00000004:00080000:2.0:1705683932.410559:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472491368ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410563:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1467, 88 off112128 00000004:00080000:2.0:1705683932.410564:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472496615ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410569:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5490, 88 off400080 00000004:00080000:2.0:1705683932.410570:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472501945ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410574:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1468, 88 off112216 00000004:00080000:2.0:1705683932.410575:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472507517ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410580:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5491, 88 off400168 00000004:00080000:2.0:1705683932.410581:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472513170ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410585:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1469, 88 off112304 00000004:00080000:2.0:1705683932.410587:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472518850ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410591:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5492, 88 off400256 00000004:00080000:2.0:1705683932.410593:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472524867ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410597:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1470, 88 off112392 00000004:00080000:2.0:1705683932.410598:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472530658ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410603:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5493, 88 off400344 00000004:00080000:2.0:1705683932.410604:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472536560ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410609:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1471, 88 off112480 00000004:00080000:2.0:1705683932.410610:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472542340ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410614:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5494, 88 off400432 00000004:00080000:2.0:1705683932.410616:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472547925ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410620:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1472, 88 off112568 00000004:00080000:2.0:1705683932.410621:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472553338ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410625:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5495, 88 off400520 00000004:00080000:2.0:1705683932.410626:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472558785ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410631:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1473, 88 off112656 00000004:00080000:2.0:1705683932.410632:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472564500ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410637:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5496, 88 off400608 00000004:00080000:2.0:1705683932.410638:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472569897ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410642:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1474, 88 off112744 00000004:00080000:2.0:1705683932.410643:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472575225ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410647:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5497, 88 off400696 00000004:00080000:2.0:1705683932.410648:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472580535ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410653:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1475, 88 off112832 00000004:00080000:2.0:1705683932.410654:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472585970ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410658:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5498, 88 off400784 00000004:00080000:2.0:1705683932.410659:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472591340ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410663:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1476, 88 off112920 00000004:00080000:2.0:1705683932.410664:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472596702ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410669:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5499, 88 off400872 00000004:00080000:2.0:1705683932.410670:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472602175ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410674:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1477, 88 off113008 00000004:00080000:2.0:1705683932.410675:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472607735ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410680:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5500, 88 off400960 00000004:00080000:2.0:1705683932.410681:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472613160ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410685:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1478, 88 off113096 00000004:00080000:2.0:1705683932.410686:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472618635ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410691:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5501, 88 off401048 00000004:00080000:2.0:1705683932.410692:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472624157ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410696:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1479, 88 off113184 00000004:00080000:2.0:1705683932.410697:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472629700ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410702:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5502, 88 off401136 00000004:00080000:2.0:1705683932.410703:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472635547ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410727:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1480, 88 off113272 00000004:00080000:2.0:1705683932.410729:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472660915ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410735:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5503, 88 off401224 00000004:00080000:2.0:1705683932.410736:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472668560ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410741:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1481, 88 off113360 00000004:00080000:2.0:1705683932.410742:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472674620ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410747:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5504, 88 off401312 00000004:00080000:2.0:1705683932.410748:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472680418ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410753:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1482, 88 off113448 00000004:00080000:2.0:1705683932.410754:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472686105ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410779:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5506, 88 off401496 00000004:00080000:2.0:1705683932.410781:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472713178ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410788:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1483, 88 off113536 00000004:00080000:2.0:1705683932.410789:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472721690ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410794:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5507, 88 off401584 00000004:00080000:2.0:1705683932.410796:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472728065ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410800:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1484, 88 off113624 00000004:00080000:2.0:1705683932.410802:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472734107ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410806:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5508, 88 off401672 00000004:00080000:2.0:1705683932.410808:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472739985ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410812:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1485, 88 off113712 00000004:00080000:2.0:1705683932.410813:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472745355ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410817:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5509, 88 off401760 00000004:00080000:2.0:1705683932.410818:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472750678ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410823:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1486, 88 off113800 00000004:00080000:2.0:1705683932.410824:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472756090ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410829:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5510, 88 off401848 00000004:00080000:2.0:1705683932.410830:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472761900ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410839:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1487, 88 off113888 00000004:00080000:2.0:1705683932.410841:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472773092ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410845:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5511, 88 off401936 00000004:00080000:2.0:1705683932.410847:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472778882ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410851:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1488, 88 off113976 00000004:00080000:2.0:1705683932.410852:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472784518ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410857:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5512, 88 off402024 00000004:00080000:2.0:1705683932.410858:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472790320ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410863:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1489, 88 off114064 00000004:00080000:2.0:1705683932.410864:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472796295ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410868:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5513, 88 off402112 00000004:00080000:2.0:1705683932.410870:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472802647ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410878:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1490, 88 off114152 00000004:00080000:2.0:1705683932.410880:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472812115ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410884:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5514, 88 off402200 00000004:00080000:2.0:1705683932.410886:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472818087ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410890:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1491, 88 off114240 00000004:00080000:2.0:1705683932.410892:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472824108ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410896:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5515, 88 off402288 00000004:00080000:2.0:1705683932.410898:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472829986ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410901:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1492, 88 off114328 00000004:00080000:2.0:1705683932.410903:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472834866ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410907:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5516, 88 off402376 00000004:00080000:2.0:1705683932.410908:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472840298ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410912:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1493, 88 off114416 00000004:00080000:2.0:1705683932.410913:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472845607ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410918:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5517, 88 off402464 00000004:00080000:2.0:1705683932.410919:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472851382ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410923:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1494, 88 off114504 00000004:00080000:2.0:1705683932.410924:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472856500ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410929:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5518, 88 off402552 00000004:00080000:2.0:1705683932.410930:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472861938ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410933:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1495, 88 off114592 00000004:00080000:2.0:1705683932.410934:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472866618ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410938:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5519, 88 off402640 00000004:00080000:2.0:1705683932.410940:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472871905ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410963:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1497, 88 off114776 00000004:00080000:2.0:1705683932.410965:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472897172ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410972:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5520, 88 off402728 00000004:00080000:2.0:1705683932.410973:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472905568ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410979:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1498, 88 off114864 00000004:00080000:2.0:1705683932.410980:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472912377ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.410985:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5521, 88 off402816 00000004:00080000:2.0:1705683932.410986:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472918166ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.410990:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1499, 88 off114952 00000004:00080000:2.0:1705683932.410992:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472923855ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.410992:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.410993:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.410996:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641020864 00000040:00080000:2.0:1705683932.410997:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5522, 88 off402904 00000004:00080000:2.0:1705683932.410998:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472930207ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411002:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1500, 88 off115040 00000004:00080000:2.0:1705683932.411003:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472935790ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411007:0:15118:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.411007:0:15118:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.411008:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5523, 88 off402992 00000004:00080000:2.0:1705683932.411009:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472941471ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411011:0:15118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920739 00000100:00100000:3.0:1705683932.411013:0:15118:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3450:6521:x1788538641020864:12345-192.168.203.41@tcp:101:dd.0 00000040:00080000:2.0:1705683932.411014:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1501, 88 off115128 00000004:00080000:2.0:1705683932.411016:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472947957ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.411017:0:15118:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:2.0:1705683932.411021:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5524, 88 off403080 00000004:00080000:2.0:1705683932.411022:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472954350ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411026:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1502, 88 off115216 00000004:00080000:2.0:1705683932.411027:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472959835ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411032:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5525, 88 off403168 00000004:00080000:2.0:1705683932.411033:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472965431ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411038:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1503, 88 off115304 00000004:00080000:2.0:1705683932.411039:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472971661ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411044:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5526, 88 off403256 00000004:00080000:2.0:1705683932.411045:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472977225ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411050:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1504, 88 off115392 00000004:00080000:2.0:1705683932.411051:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705472983410ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411056:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5527, 88 off403344 00000004:00080000:2.0:1705683932.411057:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705472989262ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411067:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1505, 88 off115480 00000004:00080000:2.0:1705683932.411068:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473000680ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411073:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5528, 88 off403432 00000004:00080000:2.0:1705683932.411074:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473006532ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411093:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1506, 88 off115568 00000004:00080000:2.0:1705683932.411094:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473026771ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411099:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5529, 88 off403520 00000004:00080000:2.0:1705683932.411101:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473032967ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411105:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1507, 88 off115656 00000004:00080000:2.0:1705683932.411107:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473038931ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411111:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5530, 88 off403608 00000004:00080000:2.0:1705683932.411113:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473045331ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411118:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1508, 88 off115744 00000004:00080000:2.0:1705683932.411119:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473051250ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411123:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5531, 88 off403696 00000004:00080000:2.0:1705683932.411125:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473057187ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411130:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1509, 88 off115832 00000004:00080000:2.0:1705683932.411131:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473063095ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411135:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5532, 88 off403784 00000004:00080000:2.0:1705683932.411136:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473068820ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411141:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1510, 88 off115920 00000004:00080000:2.0:1705683932.411142:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473074276ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411147:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5533, 88 off403872 00000004:00080000:2.0:1705683932.411148:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473080332ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411152:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1511, 88 off116008 00000004:00080000:2.0:1705683932.411153:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473085722ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411158:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5534, 88 off403960 00000004:00080000:2.0:1705683932.411159:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473091275ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411164:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1512, 88 off116096 00000004:00080000:2.0:1705683932.411166:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473098136ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411170:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5535, 88 off404048 00000004:00080000:2.0:1705683932.411171:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473103725ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411176:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1513, 88 off116184 00000004:00080000:2.0:1705683932.411178:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473110302ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411183:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5536, 88 off404136 00000004:00080000:2.0:1705683932.411184:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473116322ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411189:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1514, 88 off116272 00000004:00080000:2.0:1705683932.411190:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473122628ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411196:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5537, 88 off404224 00000004:00080000:2.0:1705683932.411197:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473129226ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411202:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1515, 88 off116360 00000004:00080000:2.0:1705683932.411203:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473135568ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411207:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5538, 88 off404312 00000004:00080000:2.0:1705683932.411208:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473140645ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.411212:0:15118:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098265180/0xefc4487a01878847 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30106f expref: -99 pid: 15118 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.411213:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1516, 88 off116448 00000004:00080000:2.0:1705683932.411214:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473146688ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411219:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5539, 88 off404400 00002000:00010000:3.0:1705683932.411219:0:15118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1705683932.411220:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473152728ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.411225:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:2.0:1705683932.411226:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1517, 88 off116536 00010000:00010000:3.0:1705683932.411226:0:15118:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1705683932.411228:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473160486ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.411228:0:15118:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098265180/0xefc4487a01878847 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30106f expref: 3451 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.411233:0:15118:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098265180/0xefc4487a01878847 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30106f expref: 3451 pid: 15118 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.411236:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5540, 88 off404488 00010000:00010000:3.0:1705683932.411237:0:15118:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098265180, rc 0) 00000004:00080000:2.0:1705683932.411238:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473170391ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411247:0:15118:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3451:6521:x1788538641020864:12345-192.168.203.41@tcp:101:dd.0 Request processed in 233us (282us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.411248:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1518, 88 off116624 00000004:00080000:2.0:1705683932.411249:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473181627ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411250:0:15118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920739 00000040:00080000:2.0:1705683932.411264:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5541, 88 off404576 00000100:00100000:3.0:1705683932.411266:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584501184:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.411267:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473198802ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.411273:0:15169:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.411275:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1519, 88 off116712 00010000:00100000:3.0:1705683932.411276:0:15169:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.411277:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473209067ns, next at 706187302248ns, rc = 0 00010000:00100000:3.0:1705683932.411277:0:15169:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.411277:0:15169:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000040:00080000:2.0:1705683932.411284:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5542, 88 off404664 00000004:00080000:2.0:1705683932.411286:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473218672ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411296:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1520, 88 off116800 00000004:00080000:2.0:1705683932.411298:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473230412ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411312:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5543, 88 off404752 00000004:00080000:2.0:1705683932.411314:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473245917ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411323:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1521, 88 off116888 00000004:00080000:2.0:1705683932.411325:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473257686ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411334:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5544, 88 off404840 00000004:00080000:2.0:1705683932.411336:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473268406ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411343:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1522, 88 off116976 00000004:00080000:2.0:1705683932.411344:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473276751ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411351:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5545, 88 off404928 00000004:00080000:2.0:1705683932.411352:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473284771ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411358:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1523, 88 off117064 00000004:00080000:2.0:1705683932.411360:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473292661ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411367:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5546, 88 off405016 00000004:00080000:2.0:1705683932.411368:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473300765ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411375:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1524, 88 off117152 00000004:00080000:2.0:1705683932.411377:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473308951ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411384:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5547, 88 off405104 00000004:00080000:2.0:1705683932.411386:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473317897ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411392:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1525, 88 off117240 00000004:00080000:2.0:1705683932.411393:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473325490ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411397:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5548, 88 off405192 00000004:00080000:2.0:1705683932.411399:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473330857ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411409:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1526, 88 off117328 00000004:00080000:2.0:1705683932.411411:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473343171ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411415:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5549, 88 off405280 00000004:00080000:2.0:1705683932.411416:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473348286ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411421:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1527, 88 off117416 00000004:00080000:2.0:1705683932.411422:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473354671ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411426:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5550, 88 off405368 00000004:00080000:2.0:1705683932.411427:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473359551ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411432:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1528, 88 off117504 00000004:00080000:2.0:1705683932.411433:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473365147ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411437:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5551, 88 off405456 00000004:00080000:2.0:1705683932.411438:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473369966ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411441:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1529, 88 off117592 00000004:00080000:2.0:1705683932.411442:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473374687ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.411449:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.411454:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.411459:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.411463:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098265680/0xefc4487a01878728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.411469:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5552, 88 off405544 00000004:00080000:2.0:1705683932.411471:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473403082ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411477:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1530, 88 off117680 00010000:00010000:3.0:1705683932.411477:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1705683932.411479:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473411042ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411485:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5553, 88 off405632 00000004:00080000:2.0:1705683932.411486:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473418152ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411490:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1531, 88 off117768 00000004:00080000:2.0:1705683932.411491:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473423590ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411495:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5554, 88 off405720 00000004:00080000:2.0:1705683932.411496:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473428397ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411500:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1532, 88 off117856 00000004:00080000:2.0:1705683932.411501:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473433175ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411504:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5555, 88 off405808 00000004:00080000:2.0:1705683932.411505:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473437728ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411509:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1533, 88 off117944 00000004:00080000:2.0:1705683932.411510:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473442347ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411514:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5556, 88 off405896 00000004:00080000:2.0:1705683932.411515:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473446930ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411518:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1534, 88 off118032 00000004:00080000:2.0:1705683932.411519:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473451531ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411523:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5557, 88 off405984 00000004:00080000:2.0:1705683932.411524:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473456570ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411528:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1535, 88 off118120 00000004:00080000:2.0:1705683932.411529:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473461451ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411539:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5558, 88 off406072 00000004:00080000:2.0:1705683932.411541:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473472907ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411545:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1536, 88 off118208 00000004:00080000:2.0:1705683932.411546:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473478045ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411551:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5559, 88 off406160 00000004:00080000:2.0:1705683932.411552:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473484675ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411556:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1537, 88 off118296 00000004:00080000:2.0:1705683932.411557:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473489522ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411561:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5560, 88 off406248 00000004:00080000:2.0:1705683932.411562:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473494430ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411562:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3242:3082:x1788538584500544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6620us (6643us total) trans 4295348240 rc 0/0 00000040:00080000:2.0:1705683932.411566:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1538, 88 off118384 00000004:00080000:2.0:1705683932.411567:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473499217ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411567:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920720 00000040:00080000:2.0:1705683932.411575:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5561, 88 off406336 00000004:00080000:2.0:1705683932.411576:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473508186ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411580:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1539, 88 off118472 00000004:00080000:2.0:1705683932.411581:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473513366ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411586:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5562, 88 off406424 00000004:00080000:2.0:1705683932.411587:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473519336ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.411588:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e38000/2, rc 0, transno 380944 00000040:00080000:2.0:1705683932.411591:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1540, 88 off118560 00000100:00100000:3.0:1705683932.411591:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584500544:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.411592:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473524195ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411595:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5563, 88 off406512 00000004:00080000:2.0:1705683932.411597:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473528861ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411600:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1541, 88 off118648 00000004:00080000:2.0:1705683932.411601:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473533330ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411610:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5564, 88 off406600 00000004:00080000:2.0:1705683932.411611:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473543392ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411615:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1542, 88 off118736 00000004:00080000:2.0:1705683932.411616:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473548695ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411624:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5565, 88 off406688 00000004:00080000:2.0:1705683932.411626:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473558026ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411635:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584501952:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.411648:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1543, 88 off118824 00000100:00100000:3.0:1705683932.411649:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584502272:192.168.203.41@tcp:104: 00000004:00080000:2.0:1705683932.411651:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473582862ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.411660:0:15188:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098265400/0xefc4487a01878808 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30103e expref: 4011 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.411666:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5566, 88 off406776 00000004:00080000:2.0:1705683932.411667:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473599423ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.411667:0:15188:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098265400, rc 0) 00000040:00080000:2.0:1705683932.411672:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1544, 88 off118912 00000004:00080000:2.0:1705683932.411673:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473605178ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411679:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5567, 88 off406864 00000004:00080000:2.0:1705683932.411680:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473612248ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411680:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e280500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:4708:x1788538641020032:12345-192.168.203.41@tcp:101:dd.0 Request processed in 4082us (4118us total) trans 0 rc 0/0 00000040:00080000:2.0:1705683932.411684:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1545, 88 off119000 00000100:00100000:3.0:1705683932.411684:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920733 00000004:00080000:2.0:1705683932.411685:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473617228ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411690:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5568, 88 off406952 00000004:00080000:2.0:1705683932.411692:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473623988ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411695:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1546, 88 off119088 00000004:00080000:2.0:1705683932.411696:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473628645ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411701:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5569, 88 off407040 00000004:00080000:2.0:1705683932.411703:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473634998ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411706:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1547, 88 off119176 00000004:00080000:2.0:1705683932.411708:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473639895ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411724:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5570, 88 off407128 00000004:00080000:2.0:1705683932.411725:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473657325ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411729:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1548, 88 off119264 00000004:00080000:2.0:1705683932.411730:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473662813ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411736:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5571, 88 off407216 00000004:00080000:2.0:1705683932.411737:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473669120ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411740:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1549, 88 off119352 00000004:00080000:2.0:1705683932.411742:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473674236ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411747:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5572, 88 off407304 00000004:00080000:2.0:1705683932.411748:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473680088ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411751:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1550, 88 off119440 00000004:00080000:2.0:1705683932.411752:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473684738ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411757:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5573, 88 off407392 00000100:00100000:3.0:1705683932.411758:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e286900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584503360:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1705683932.411759:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473690956ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411762:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1551, 88 off119528 00000004:00080000:2.0:1705683932.411763:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473695616ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411767:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5574, 88 off407480 00000004:00080000:2.0:1705683932.411768:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473700276ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411775:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1552, 88 off119616 00000004:00080000:2.0:1705683932.411776:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473708308ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411776:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.411780:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5575, 88 off407568 00000004:00080000:2.0:1705683932.411781:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473713235ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411786:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1553, 88 off119704 00000004:00080000:2.0:1705683932.411788:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473719991ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411791:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5576, 88 off407656 00000004:00080000:2.0:1705683932.411793:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473724913ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411794:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584503424:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.411798:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1554, 88 off119792 00000004:00080000:2.0:1705683932.411799:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473731226ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411802:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5577, 88 off407744 00000004:00080000:2.0:1705683932.411804:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473735885ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411807:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.411809:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1555, 88 off119880 00000004:00080000:2.0:1705683932.411810:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473742440ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411815:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5578, 88 off407832 00000004:00080000:2.0:1705683932.411816:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473747996ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411821:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1556, 88 off119968 00000004:00080000:2.0:1705683932.411822:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473754711ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411826:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5579, 88 off407920 00000004:00080000:2.0:1705683932.411827:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473759721ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411833:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1557, 88 off120056 00000100:00100000:3.0:1705683932.411833:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.411834:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473766160ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411834:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.411838:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920740 00000040:00080000:2.0:1705683932.411840:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5580, 88 off408008 00000004:00080000:2.0:1705683932.411841:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473773498ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.411841:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3242:3084:x1788538584503360:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.411848:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1558, 88 off120144 00000004:00080000:2.0:1705683932.411849:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473781255ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411854:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5581, 88 off408096 00000004:00080000:2.0:1705683932.411855:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473787828ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411861:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1559, 88 off120232 00000004:00080000:2.0:1705683932.411862:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473794345ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411868:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5582, 88 off408184 00000004:00080000:2.0:1705683932.411869:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473801088ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411874:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1560, 88 off120320 00000004:00080000:2.0:1705683932.411875:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473807738ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411880:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5583, 88 off408272 00000004:00080000:2.0:1705683932.411882:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473813883ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411887:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1561, 88 off120408 00000004:00080000:2.0:1705683932.411888:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473820038ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411893:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5584, 88 off408360 00000004:00080000:2.0:1705683932.411894:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473826686ns, next at 706174782226ns, rc = 0 00002000:00010000:3.0:1705683932.411898:0:15188:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95d9:0x0] updating lvb size from disk: 0 -> 0 00000040:00080000:2.0:1705683932.411899:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1562, 88 off120496 00002000:00010000:3.0:1705683932.411900:0:15188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95d9:0x0] updating lvb mtime from disk: 0 -> 0 00000004:00080000:2.0:1705683932.411901:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473832858ns, next at 706187302248ns, rc = 0 00002000:00010000:3.0:1705683932.411901:0:15188:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.411902:0:15188:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95d9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.411904:0:15188:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95d9:0x0] updating lvb blocks from disk: 0 -> 0 00000040:00080000:2.0:1705683932.411906:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5585, 88 off408448 00000004:00080000:2.0:1705683932.411907:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473839078ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411912:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1563, 88 off120584 00000004:00080000:2.0:1705683932.411913:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473845285ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411918:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5586, 88 off408536 00000004:00080000:2.0:1705683932.411919:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473851601ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411924:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1564, 88 off120672 00000100:00100000:3.0:1705683932.411924:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3243:3084:x1788538584503360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (147us total) trans 4295348242 rc 0/0 00000004:00080000:2.0:1705683932.411925:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473857808ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411929:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920740 00000040:00080000:2.0:1705683932.411930:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5587, 88 off408624 00000004:00080000:2.0:1705683932.411932:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473863991ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411937:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1565, 88 off120760 00000004:00080000:2.0:1705683932.411938:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473870058ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.411943:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5588, 88 off408712 00000004:00080000:2.0:1705683932.411944:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473876141ns, next at 706174782226ns, rc = 0 00000004:00080000:3.0:1705683932.411946:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e286900/2, rc 0, transno 380946 00000040:00080000:2.0:1705683932.411949:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1566, 88 off120848 00000004:00080000:2.0:1705683932.411950:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473882388ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.411959:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e286900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584503360:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.411980:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584501888:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.411983:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5589, 88 off408800 00000004:00080000:2.0:1705683932.411985:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473917018ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.411991:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1567, 88 off120936 00010000:00010000:3.0:1705683932.411992:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.411993:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473925278ns, next at 706187302248ns, rc = 0 00010000:00100000:3.0:1705683932.411997:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.411997:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00000040:00080000:2.0:1705683932.411998:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5590, 88 off408888 00010000:00100000:3.0:1705683932.411998:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000004:00080000:2.0:1705683932.412000:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473932041ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412004:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584503488:0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.412005:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1568, 88 off121024 00000004:00080000:2.0:1705683932.412007:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473939025ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412012:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5591, 88 off408976 00000004:00080000:2.0:1705683932.412013:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473945783ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412019:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1569, 88 off121112 00000100:00100000:3.0:1705683932.412019:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1705683932.412020:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473952808ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412026:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5592, 88 off409064 00000004:00080000:2.0:1705683932.412027:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473959163ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412032:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1570, 88 off121200 00000004:00080000:2.0:1705683932.412033:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473965328ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.412037:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.412038:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5593, 88 off409152 00000100:00100000:3.0:1705683932.412038:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.412039:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473971553ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412041:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584503488 00000040:00080000:2.0:1705683932.412044:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1571, 88 off121288 00000004:00080000:2.0:1705683932.412045:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705473977693ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412051:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5594, 88 off409240 00000100:00100000:3.0:1705683932.412051:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.412051:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.412052:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705473984276ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412054:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920742 00000100:00100000:2.0:1705683932.412056:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.412056:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.412057:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3243:3082:x1788538584503488:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.412067:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1572, 88 off121376 00000004:00080000:2.0:1705683932.412069:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474001589ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412095:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5595, 88 off409328 00000004:00080000:2.0:1705683932.412098:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474030518ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412111:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1573, 88 off121464 00000004:00080000:2.0:1705683932.412114:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474045750ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412123:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5596, 88 off409416 00000004:00080000:2.0:1705683932.412125:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474056956ns, next at 706174782226ns, rc = 0 00002000:00010000:3.0:1705683932.412125:0:15188:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.412127:0:15188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95da:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.412128:0:15188:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.412129:0:15188:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95da:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.412130:0:15188:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95da:0x0] updating lvb blocks from disk: 0 -> 0 00000040:00080000:2.0:1705683932.412134:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1574, 88 off121552 00000004:00080000:2.0:1705683932.412136:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474068551ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412146:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5597, 88 off409504 00000004:00080000:2.0:1705683932.412148:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474080469ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412149:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3244:3082:x1788538584503488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (129us total) trans 4295348243 rc 0/0 00000100:00100000:3.0:1705683932.412153:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920742 00000040:00080000:2.0:1705683932.412158:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1575, 88 off121640 00000004:00080000:2.0:1705683932.412160:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474092366ns, next at 706187302248ns, rc = 0 00000004:00080000:3.0:1705683932.412169:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc5f00/2, rc 0, transno 380947 00000100:00100000:3.0:1705683932.412180:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584503488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.412196:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133630500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584503232:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.412206:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.412210:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc5a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584503680:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.412223:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.412233:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.412234:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.412237:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584503680 00000040:00080000:2.0:1705683932.412243:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5599, 88 off409688 00000100:00100000:3.0:1705683932.412245:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.412245:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.412247:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474179055ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412247:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920744 00000100:00100000:3.0:1705683932.412249:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3244:3084:x1788538584503680:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.412256:0:15188:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34515 count 1 00000040:00080000:2.0:1705683932.412264:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1576, 88 off121728 00000004:00080000:2.0:1705683932.412267:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474199171ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412280:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5600, 88 off409776 00000004:00080000:2.0:1705683932.412282:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474214486ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412294:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1577, 88 off121816 00000004:00080000:2.0:1705683932.412296:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474228208ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412307:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5601, 88 off409864 00000004:00080000:2.0:1705683932.412309:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474241251ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412320:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1578, 88 off121904 00000004:00080000:2.0:1705683932.412322:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474253835ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412332:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5602, 88 off409952 00000004:00080000:2.0:1705683932.412334:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474266600ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412346:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1579, 88 off121992 00000004:00080000:2.0:1705683932.412348:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474280048ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412359:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5603, 88 off410040 00000004:00080000:2.0:1705683932.412361:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474293126ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412372:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1580, 88 off122080 00000004:00080000:2.0:1705683932.412374:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474306356ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412385:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5604, 88 off410128 00000004:00080000:2.0:1705683932.412387:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474319326ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412398:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1581, 88 off122168 00010000:00010000:3.0:1705683932.412399:0:15188:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1705683932.412400:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474332630ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.412406:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de5af80/0xefc4487a01806f1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e21 expref: 4012 pid: 15116 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.412411:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5605, 88 off410216 00010000:00010000:3.0:1705683932.412411:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd6d680/0xefc4487a0185a015 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bd1 expref: 5968 pid: 15109 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1705683932.412413:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474345493ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.412415:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.412416:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.412417:0:15188:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.412424:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1582, 88 off122256 00000004:00080000:2.0:1705683932.412426:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474358189ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.412428:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd6d680/0xefc4487a0185a015 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bd1 expref: 5968 pid: 15109 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.412434:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd6d680/0xefc4487a0185a015 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8bd1 expref: 5968 pid: 15109 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.412436:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5606, 88 off410304 00000004:00080000:2.0:1705683932.412437:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474369560ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412441:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584503744:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.412444:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1583, 88 off122344 00000004:00080000:2.0:1705683932.412445:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474377131ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412450:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5607, 88 off410392 00000004:00080000:2.0:1705683932.412452:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474383888ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412457:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1584, 88 off122432 00000004:00080000:2.0:1705683932.412458:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474390841ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.412459:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012de5af80/0xefc4487a01806f1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e21 expref: 4011 pid: 15116 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1705683932.412464:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5608, 88 off410480 00000004:00080000:2.0:1705683932.412465:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474397128ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.412465:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012de5af80/0xefc4487a01806f1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e21 expref: 4011 pid: 15116 timeout: 805 lvb_type: 1 00000040:00080000:2.0:1705683932.412470:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1585, 88 off122520 00000004:00080000:2.0:1705683932.412471:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474403519ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.412471:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584503808:192.168.203.41@tcp:104: 00000040:00080000:2.0:1705683932.412476:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5609, 88 off410568 00000004:00080000:2.0:1705683932.412478:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474409875ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.412483:0:15188:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2baf00 going to sleep for 11 seconds 00010000:00010000:2.0:1705683932.412490:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1705683932.412492:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013519a800/0xefc4487a01878878 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4355:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14377 initiator: MDT0 00000100:00100000:3.0:1705683932.412501:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584502720:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.412505:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88013519a800 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.412506:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519a800/0xefc4487a01878878 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4355:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14377 initiator: MDT0 00000100:00100000:3.0:1705683932.412506:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584502784:192.168.203.41@tcp:104: 00010000:00010000:2.0:1705683932.412508:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519a800/0xefc4487a01878878 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4355:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.412515:0:11072:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4355:0x0].0x0 (ffff8800a0c74000) 00010000:00010000:3.0:1705683932.412515:0:15135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.412516:0:11072:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1705683932.412517:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013519a800/0xefc4487a01878878 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4355:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14377 initiator: MDT0 00010000:00010000:2.0:1705683932.412519:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519a800/0xefc4487a01878878 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4355:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14377 initiator: MDT0 00010000:00100000:3.0:1705683932.412520:0:15135:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.412521:0:15135:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.412521:0:15135:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:2.0:1705683932.412523:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.412524:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.412525:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.412530:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1586, 88 off122608 00000004:00080000:2.0:1705683932.412531:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474463801ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412538:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5610, 88 off410656 00000004:00080000:2.0:1705683932.412539:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474471229ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412545:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1587, 88 off122696 00000004:00080000:2.0:1705683932.412547:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474479278ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412552:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5611, 88 off410744 00000004:00080000:2.0:1705683932.412553:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474485611ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412559:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1588, 88 off122784 00000004:00080000:2.0:1705683932.412560:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474492653ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412565:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5612, 88 off410832 00000004:00080000:2.0:1705683932.412566:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474498563ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412594:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1590, 88 off122968 00000004:00080000:2.0:1705683932.412596:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474528308ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412604:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5613, 88 off410920 00000004:00080000:2.0:1705683932.412605:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474537415ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412611:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1591, 88 off123056 00000004:00080000:2.0:1705683932.412612:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474544600ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412618:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5614, 88 off411008 00000004:00080000:2.0:1705683932.412619:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474551228ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412624:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1592, 88 off123144 00000004:00080000:2.0:1705683932.412625:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474557296ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412629:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5615, 88 off411096 00000004:00080000:2.0:1705683932.412630:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474562833ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412635:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1593, 88 off123232 00000004:00080000:2.0:1705683932.412636:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474568356ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412640:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5616, 88 off411184 00000004:00080000:2.0:1705683932.412642:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474574085ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412646:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1594, 88 off123320 00000004:00080000:2.0:1705683932.412647:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474579585ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412652:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5617, 88 off411272 00000004:00080000:2.0:1705683932.412653:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474584958ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412656:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1595, 88 off123408 00000004:00080000:2.0:1705683932.412657:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474589489ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412661:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5618, 88 off411360 00000004:00080000:2.0:1705683932.412662:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474594820ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412668:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1596, 88 off123496 00000004:00080000:2.0:1705683932.412669:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474601179ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412673:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5619, 88 off411448 00000004:00080000:2.0:1705683932.412674:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474606681ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412679:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1597, 88 off123584 00000004:00080000:2.0:1705683932.412680:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474612279ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412684:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5620, 88 off411536 00000004:00080000:2.0:1705683932.412685:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474617710ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412690:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1598, 88 off123672 00000004:00080000:2.0:1705683932.412691:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474623150ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412695:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5621, 88 off411624 00000004:00080000:2.0:1705683932.412697:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474628860ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412701:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1599, 88 off123760 00000004:00080000:2.0:1705683932.412702:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474634179ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412706:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5622, 88 off411712 00000004:00080000:2.0:1705683932.412707:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474639803ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412724:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1600, 88 off123848 00000004:00080000:2.0:1705683932.412726:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474658003ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412731:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5623, 88 off411800 00000004:00080000:2.0:1705683932.412732:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474664118ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412736:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1601, 88 off123936 00000004:00080000:2.0:1705683932.412737:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474669713ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412743:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5624, 88 off411888 00000004:00080000:2.0:1705683932.412744:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474676496ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412748:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1602, 88 off124024 00000004:00080000:2.0:1705683932.412750:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474681883ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412755:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5625, 88 off411976 00000004:00080000:2.0:1705683932.412756:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474688110ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412760:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1603, 88 off124112 00000004:00080000:2.0:1705683932.412761:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474693558ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412766:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5626, 88 off412064 00000004:00080000:2.0:1705683932.412767:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474699636ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412771:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1604, 88 off124200 00000004:00080000:2.0:1705683932.412773:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474704900ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412778:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5627, 88 off412152 00000004:00080000:2.0:1705683932.412779:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474711706ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412783:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1605, 88 off124288 00000004:00080000:2.0:1705683932.412785:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474716853ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412790:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5628, 88 off412240 00000004:00080000:2.0:1705683932.412791:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474723085ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412795:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1606, 88 off124376 00000004:00080000:2.0:1705683932.412796:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474728238ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412801:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5629, 88 off412328 00000004:00080000:2.0:1705683932.412802:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474734728ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412806:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1607, 88 off124464 00000004:00080000:2.0:1705683932.412807:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474739843ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412813:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5630, 88 off412416 00000004:00080000:2.0:1705683932.412814:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474746411ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412818:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1608, 88 off124552 00000004:00080000:2.0:1705683932.412819:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474751553ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412824:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5631, 88 off412504 00000004:00080000:2.0:1705683932.412826:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474757880ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412830:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1609, 88 off124640 00000004:00080000:2.0:1705683932.412831:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474763788ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412836:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5632, 88 off412592 00000004:00080000:2.0:1705683932.412838:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474769933ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412843:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1610, 88 off124728 00000004:00080000:2.0:1705683932.412844:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474776353ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412850:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5633, 88 off412680 00000004:00080000:2.0:1705683932.412851:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474783038ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412855:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1611, 88 off124816 00000004:00080000:2.0:1705683932.412856:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474788449ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412863:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5634, 88 off412768 00000004:00080000:2.0:1705683932.412864:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474796671ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.412866:0:15169:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412873:0:15169:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412878:0:15169:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.412880:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1612, 88 off124904 00000004:00080000:2.0:1705683932.412882:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474814731ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.412882:0:15169:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412892:0:15169:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:2.0:1705683932.412895:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5635, 88 off412856 00000004:00080000:2.0:1705683932.412897:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474829719ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.412897:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.412899:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412904:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098266a80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.412905:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412909:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.412910:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1613, 88 off124992 00000004:00080000:2.0:1705683932.412912:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474844131ns, next at 706187302248ns, rc = 0 00010000:00010000:3.0:1705683932.412917:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.412921:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098266a80/0xefc4487a01878752 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1705683932.412922:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5636, 88 off412944 00000004:00080000:2.0:1705683932.412924:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474856733ns, next at 706174782226ns, rc = 0 00010000:00010000:3.0:1705683932.412931:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.412931:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.412932:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.412934:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1614, 88 off125080 00000004:00080000:2.0:1705683932.412936:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474868521ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412945:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5637, 88 off413032 00000004:00080000:2.0:1705683932.412947:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474879019ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412956:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1615, 88 off125168 00000004:00080000:2.0:1705683932.412959:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474890931ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412968:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5638, 88 off413120 00000004:00080000:2.0:1705683932.412970:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474902401ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.412980:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1616, 88 off125256 00000004:00080000:2.0:1705683932.412982:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474914143ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.412992:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5639, 88 off413208 00000004:00080000:2.0:1705683932.412994:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474926741ns, next at 706174782226ns, rc = 0 00010000:00010000:2.0:1705683932.413003:0:6522:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1705683932.413006:0:6522:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dfa9b80/0xefc4487a01878767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.413010:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+3245:3082:x1788538584501056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7318us (7339us total) trans 4295348244 rc 0/0 00010000:00010000:2.0:1705683932.413011:0:6522:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88012dfa9b80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:2.0:1705683932.413013:0:6522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dfa9b80/0xefc4487a01878767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.413015:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920723 00010000:00010000:2.0:1705683932.413017:0:6522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dfa9b80/0xefc4487a01878767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.413023:0:6522:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dfa9b80/0xefc4487a01878767 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.413026:0:6522:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dfa9b80/0xefc4487a01878767 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1705683932.413034:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.413035:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1705683932.413035:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1705683932.413045:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1617, 88 off125344 00000004:00080000:2.0:1705683932.413048:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705474979853ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.413060:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5640, 88 off413296 00000004:00080000:2.0:1705683932.413062:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705474994083ns, next at 706174782226ns, rc = 0 00000004:00080000:2.0:1705683932.413096:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d8d4600/2, rc 0, transno 380949 00000100:00100000:2.0:1705683932.413102:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d4600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584501312:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413126:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1705683932.413131:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584503936:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1705683932.413136:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d8d7800/2, rc 0, transno 380950 00000100:00100000:3.0:1705683932.413141:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501568:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1705683932.413148:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099f0ad00/2, rc 0, transno 380948 00000100:00100000:2.0:1705683932.413149:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.413149:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584501056:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413179:0:3082:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc1900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584504064:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413189:0:3082:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.413191:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc3700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584504000:0@lo:6:osp-syn-1-1.0 00000040:00080000:2.0:1705683932.413204:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1618, 88 off125432 00000004:00080000:2.0:1705683932.413206:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705475138679ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.413206:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1705683932.413215:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5641, 88 off413384 00000004:00080000:2.0:1705683932.413217:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705475149076ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.413222:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1619, 88 off125520 00000100:00100000:3.0:1705683932.413223:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.413224:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705475156348ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.413224:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.413227:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584503936 00000040:00080000:2.0:1705683932.413230:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5642, 88 off413472 00000004:00080000:2.0:1705683932.413231:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705475163113ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.413236:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1620, 88 off125608 00000004:00080000:2.0:1705683932.413237:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705475169831ns, next at 706187302248ns, rc = 0 00000100:00100000:3.0:1705683932.413238:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.413239:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.413241:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584504064 00000040:00080000:2.0:1705683932.413243:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5643, 88 off413560 00000004:00080000:2.0:1705683932.413244:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705475176506ns, next at 706174782226ns, rc = 0 00000100:00100000:3.0:1705683932.413247:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.413248:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000040:00080000:2.0:1705683932.413250:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1621, 88 off125696 00000100:00100000:3.0:1705683932.413251:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920746 00000100:00100000:3.0:1705683932.413253:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131dc3200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3247:3082:x1788538584504064:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413259:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:2.0:1705683932.413260:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00080000:2.0:1705683932.413265:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705475197293ns, next at 706187302248ns, rc = 0 00000040:00080000:2.0:1705683932.413271:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5644, 88 off413648 00000004:00080000:2.0:1705683932.413272:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 705475204781ns, next at 706174782226ns, rc = 0 00000040:00080000:2.0:1705683932.413278:0:14255:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1622, 88 off125784 00000004:00080000:2.0:1705683932.413279:0:14255:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 705475211397ns, next at 706187302248ns, rc = 0 00000004:00080000:2.0:1705683932.413315:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc7800/2, rc 0, transno 380951 00000100:00100000:2.0:1705683932.413318:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584503936:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413331:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131dc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584504192:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1705683932.413341:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00000400:2.0:1705683932.413363:0:14255:0:(osd_internal.h:1414:osd_trans_exec_check()) lustre-MDT0001: opcode 7: used 23, used now 1, reserved 22 00002000:00010000:3.0:1705683932.413381:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.413383:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95dc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.413384:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.413385:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95dc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.413387:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.413412:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131dc3200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3249:3082:x1788538584504064:12345-0@lo:2:osp-syn-1-1.0 Request processed in 158us (223us total) trans 4295348248 rc 0/0 00000100:00100000:3.0:1705683932.413416:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920746 00010000:00010000:3.0:1705683932.413826:0:15135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.413831:0:15135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.413857:0:15135:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.413862:0:15135:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098266f80/0xefc4487a01878816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.413904:0:15135:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1705683932.414097:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3249:3083:x1788538584502656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6054us (6126us total) trans 4295348249 rc 0/0 00000100:00100000:3.0:1705683932.414102:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920735 00000004:00080000:3.0:1705683932.414132:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e39900/2, rc 0, transno 380953 00000100:00100000:3.0:1705683932.414137:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099e39900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584502656:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.414179:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584504576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.414219:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1705683932.414260:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.414265:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.414270:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.414307:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.414345:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1705683932.414498:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3251:3084:x1788538584501824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7437us (7519us total) trans 4295348251 rc 0/0 00000100:00100000:3.0:1705683932.414503:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920731 00000100:00100000:3.0:1705683932.415257:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584503296:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.415293:0:15215:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.415326:0:15215:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.415327:0:15215:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.415328:0:15215:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00080000:00000400:2.0:1705683932.415605:0:14255:0:(osd_handler.c:1972:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00010000:00010000:3.0:1705683932.415617:0:15215:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415634:0:15215:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415639:0:15215:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415644:0:15215:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415651:0:15215:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1705683932.415656:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1705683932.415678:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415699:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098266800 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.415700:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415721:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415740:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415744:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098266800/0xefc4487a018787f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415766:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.415767:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415784:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098267700 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.415785:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415789:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415795:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415811:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098267700/0xefc4487a01878840 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.415820:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.415821:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.415822:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.415968:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3253:3084:x1788538584503168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7168us (7191us total) trans 4295348253 rc 0/0 00000100:00100000:3.0:1705683932.415973:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920738 00000100:00100000:3.0:1705683932.416019:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.416020:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.416024:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584505152 00000100:00100000:3.0:1705683932.416033:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.416033:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.416050:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920759 00000100:00100000:3.0:1705683932.416053:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090132800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3253:3084:x1788538584505152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.416099:0:15135:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34520 count 1 00010000:00010000:3.0:1705683932.416286:0:15135:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.416295:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009872a080/0xefc4487a01806fb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ec2 expref: 4006 pid: 15136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.416299:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5966 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.416303:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.416304:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.416305:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.416316:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5966 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.416321:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5966 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.416342:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efdf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584505216:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.416372:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009872a080/0xefc4487a01806fb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ec2 expref: 4006 pid: 15136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.416378:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009872a080/0xefc4487a01806fb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ec2 expref: 4006 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.416404:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584505280:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.416428:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.417118:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.417210:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584503744:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.417217:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584503808:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.417252:0:15188:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.417257:0:15188:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.417258:0:15188:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.417259:0:15188:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417292:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417293:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417297:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641023232 00000100:00100000:3.0:1705683932.417321:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417321:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417324:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920760 00000100:00100000:3.0:1705683932.417327:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3533:6496:x1788538641023232:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.417333:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.417469:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136161e00/0xefc4487a01806eee lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1dfe expref: 4007 pid: 15141 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.417478:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136161e00/0xefc4487a01806eee lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1dfe expref: 4007 pid: 15141 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.417487:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136161e00/0xefc4487a01806eee lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1dfe expref: 4007 pid: 15141 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.417493:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.417494:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.417495:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417499:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417511:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.417522:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090136900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:1856:x1788538641023040:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.417525:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332908 00010000:00010000:0.0:1705683932.417539:0:14216:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417543:0:14216:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417547:0:14216:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417554:0:14216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417561:0:14216:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.417645:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133636400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+3254:3081:x1788538584503424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5798us (5836us total) trans 4295348254 rc 0/0 00000100:00100000:0.0:1705683932.417650:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920741 00000100:00100000:0.0:1705683932.417658:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417659:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417660:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417661:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641023360 00000100:00100000:3.0:1705683932.417661:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417671:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417672:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417674:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641023488 00000100:00100000:3.0:1705683932.417675:0:6533:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641023424 00000100:00100000:0.0:1705683932.417681:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417682:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.417685:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920761 00000100:00100000:0.0:1705683932.417688:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090135f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3451:16443:x1788538641023360:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.417688:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417688:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.417691:0:6533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413401 00010000:00010000:0.0:1705683932.417693:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.417694:0:6533:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1921:7185:x1788538641023424:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:3.0:1705683932.417707:0:6533:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1705683932.417740:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134dbad00/0xefc4487a01878300 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4123:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ed9 expref: 1921 pid: 14202 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.417752:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0c36f80/0xefc4487a01878204 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x4123:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e7e expref: 1920 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.417759:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4123:0x0].0x0 (ffff8800a114ae00) 00010000:00010000:3.0:1705683932.417761:0:6533:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.417797:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.417813:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.417829:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.417938:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013232af80/0xefc4487a01878943 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x40bb:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.417943:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013232af80/0xefc4487a01878943 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.417947:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013232af80/0xefc4487a01878943 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.417971:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb7ca00/0xefc4487a0187894a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010c3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417984:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131ee4f00/0xefc4487a017f467f lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca013 expref: 3534 pid: 15106 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.417988:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.417989:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.417991:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb7ca00/0xefc4487a0187894a lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010c3 expref: 3452 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418008:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131ee4f00/0xefc4487a017f467f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca013 expref: 3533 pid: 15106 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418014:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131ee4f00/0xefc4487a017f467f lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca013 expref: 3533 pid: 15106 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.418021:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584505344:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.418037:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012cc51c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.418048:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00000004:00080000:0.0:1705683932.418055:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e285500/2, rc 0, transno 380958 00010000:00010000:3.0:1705683932.418055:0:6533:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1705683932.418061:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584503424:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.418091:0:6533:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.418110:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090136900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584505408:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.418117:0:6533:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1705683932.418123:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.418126:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.418152:0:15191:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e283200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0001_UUID:15191:1788538584504256:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.418159:0:15191:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8e1b80/0xefc4487a01806f42 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e44 expref: 4004 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.418161:0:6533:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1788538584505472:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.418166:0:15191:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e281900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0001_UUID:15191:1788538584504320:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.418177:0:15191:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.418182:0:15191:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.418183:0:15191:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.418184:0:15191:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.418197:0:6533:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2baf00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.418206:0:15188:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.418211:0:15188:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.418212:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a665a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584504960:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.418231:0:15188:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.418236:0:15188:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.418249:0:15188:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1705683932.418253:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1705683932.418255:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418260:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880087736080 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.418261:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418266:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418274:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418278:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087736080/0xefc4487a0187884e lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418290:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.418291:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418295:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098264a00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.418297:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418301:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418311:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418315:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098264a00/0xefc4487a01878871 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418323:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.418324:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.418325:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.418354:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090131400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584505088:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.418367:0:14282:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7f480/0xefc4487a018788e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010a7 expref: 5963 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.418374:0:14282:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7f480, rc 0) 00000100:00100000:3.0:1705683932.418411:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3254:3084:x1788538584503680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6160us (6186us total) trans 4295348255 rc 0/0 00000100:00100000:3.0:1705683932.418416:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920744 00010000:00010000:3.0:1705683932.418430:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.418433:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.418438:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7d900 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.418440:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.418446:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:16415:x1788538641022592:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 3064us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.418451:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920757 00010000:00010000:3.0:1705683932.418466:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.418473:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc5a00/2, rc 0, transno 380959 00000100:00100000:0.0:1705683932.418479:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc5a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584503680:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418501:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1705683932.418505:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.418506:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e281900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584505536:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.418509:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d900/0xefc4487a0187887f lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.418522:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1705683932.418537:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc3700/2, rc 0, transno 380960 00000100:00100000:0.0:1705683932.418541:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc3700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584504000:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418563:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1705683932.418568:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e284600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584505600:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.418575:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.418576:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.418577:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.418581:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418582:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.418582:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.418587:0:15188:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584505600 00000100:00100000:0.0:1705683932.418596:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418596:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418600:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920763 00000100:00100000:0.0:1705683932.418603:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e284b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3256:3081:x1788538584505408:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.418620:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.418620:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.418624:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920764 00000100:00100000:3.0:1705683932.418626:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e283200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3256:3081:x1788538584505536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.418634:0:15188:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34521 count 1 00002000:00010000:0.0:1705683932.418676:0:14282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95df:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.418678:0:14282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95df:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.418679:0:14282:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.418680:0:14282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95df:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.418681:0:14282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.418721:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e284b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3257:3081:x1788538584505408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 99us (576us total) trans 4295348257 rc 0/0 00000100:00100000:0.0:1705683932.418727:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920763 00000004:00080000:0.0:1705683932.418798:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090136900/2, rc 0, transno 380961 00000100:00100000:0.0:1705683932.418804:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090136900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584505408:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418826:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e285000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584505728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418841:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1705683932.418855:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e284600/2, rc 0, transno 380962 00000100:00100000:0.0:1705683932.418859:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e284600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584505600:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418881:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584505792:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.418896:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.418908:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418909:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418912:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584505792 00000100:00100000:0.0:1705683932.418925:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418925:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.418928:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920767 00000100:00100000:0.0:1705683932.418930:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e287300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3258:3081:x1788538584505792:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.418955:0:15188:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.418963:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd5d680/0xefc4487a01806fe3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ee5 expref: 4001 pid: 15136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.418968:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d12a80/0xefc4487a0185a03f lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c2c expref: 5961 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.418987:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.418988:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.418989:0:15188:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.419003:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d12a80/0xefc4487a0185a03f lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c2c expref: 5961 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.419013:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d12a80/0xefc4487a0185a03f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c2c expref: 5961 pid: 15115 timeout: 805 lvb_type: 1 00002000:00010000:0.0:1705683932.419019:0:14282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95e1:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1705683932.419019:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097eff300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584505856:192.168.203.41@tcp:104: 00002000:00010000:0.0:1705683932.419021:0:14282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95e1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.419022:0:14282:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95e1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.419023:0:14282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95e1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.419024:0:14282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95e1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.419043:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e287300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3259:3081:x1788538584505792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 112us (147us total) trans 4295348259 rc 0/0 00000100:00100000:0.0:1705683932.419048:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920767 00010000:00010000:3.0:1705683932.419055:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd5d680/0xefc4487a01806fe3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ee5 expref: 4001 pid: 15136 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1705683932.419065:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e287800/2, rc 0, transno 380963 00000100:00100000:0.0:1705683932.419070:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584505792:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.419076:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd5d680/0xefc4487a01806fe3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ee5 expref: 4001 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.419104:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1705683932.419109:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009e282800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584506112:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.419109:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584505984:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.419138:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.419152:0:15220:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419153:0:15220:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.419153:0:15188:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.419172:0:15220:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584506112 00000100:00100000:3.0:1705683932.419183:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419184:0:15220:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419184:0:15220:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.419184:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419187:0:15220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920768 00000100:00100000:0.0:1705683932.419189:0:15220:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e280f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_107:lustre-MDT0001-mdtlov_UUID+3259:3081:x1788538584506112:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.419198:0:15220:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34523 count 1 00010000:00010000:3.0:1705683932.419229:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123f5f200/0xefc4487a0187896d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010bc expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.419239:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.419247:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.419248:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.419250:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123f5f200/0xefc4487a0187896d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010bc expref: 3535 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.419275:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123f5f200/0xefc4487a0187896d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010bc expref: 3535 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.419285:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123f5f200, rc 0) 00000100:00100000:3.0:1705683932.419296:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3535:6496:x1788538641023232:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1968us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.419301:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920760 00010000:00010000:0.0:1705683932.419322:0:15220:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419330:0:15220:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd5e580/0xefc4487a01806fff lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f1d expref: 4001 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.419335:0:15220:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5960 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.419339:0:15220:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.419340:0:15220:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.419340:0:15220:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419353:0:15220:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5960 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.419359:0:15220:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5960 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.419365:0:15220:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090131400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_107:lustre-OST0001_UUID:15220:1788538584506176:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.419390:0:15220:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd5e580/0xefc4487a01806fff lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f1d expref: 4001 pid: 15178 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.419396:0:15220:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd5e580/0xefc4487a01806fff lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f1d expref: 4001 pid: 15178 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.419402:0:15220:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fbad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_107:lustre-OST0001_UUID:15220:1788538584506240:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.419409:0:15220:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012cc51540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.419459:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419475:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419507:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a6658f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584505024:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.419522:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.419527:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.419528:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.419529:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419559:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.419573:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efdf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584505216:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.419580:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.419580:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584505280:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.419593:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.419602:0:15135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.419605:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00100000:3.0:1705683932.419608:0:15135:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.419609:0:15135:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419614:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419620:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419621:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419625:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641024192 00010000:00010000:0.0:1705683932.419633:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5961 pid: 15103 timeout: 805 lvb_type: 1 00010000:00100000:3.0:1705683932.419638:0:15135:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419643:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419644:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419646:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641023936 00010000:00010000:0.0:1705683932.419661:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098728a00/0xefc4487a01806f88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e83 expref: 4002 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.419670:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419671:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419673:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641024320 00010000:00010000:0.0:1705683932.419678:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0123700/0xefc4487a01806f9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1e9f expref: 4003 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.419690:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419691:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419693:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641024128 00010000:00010000:0.0:1705683932.419698:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b34500/0xefc4487a0181de4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d966a expref: 4004 pid: 15106 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.419706:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419707:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419719:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332914 00000100:00100000:0.0:1705683932.419723:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:1857:x1788538641024192:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.419729:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.419731:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5962 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.419737:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5962 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.419746:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d34ad00/0xefc4487a0185a038 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c1e expref: 5962 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.419753:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.419763:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:1857:x1788538641024192:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.419768:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332914 00000100:00100000:0.0:1705683932.419775:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419776:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.419779:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332917 00000100:00100000:0.0:1705683932.419782:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1855:x1788538641024128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.419787:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.419789:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b34500/0xefc4487a0181de4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d966a expref: 4001 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.419795:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b34500/0xefc4487a0181de4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d966a expref: 4000 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.419804:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b34500/0xefc4487a0181de4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d966a expref: 4000 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.419813:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.419814:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.419816:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7f480/0xefc4487a018788e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010a7 expref: 5960 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419821:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb7f480/0xefc4487a018788e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010a7 expref: 5960 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419833:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb7f480/0xefc4487a018788e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010a7 expref: 5959 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.419839:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584506368:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.419848:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012cc51480 going to sleep for 11 seconds 00080000:00000400:2.0:1705683932.419858:0:14255:0:(osd_handler.c:1979:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/103/9 00000100:00100000:0.0:1705683932.419873:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419882:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419894:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419905:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.419927:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584505344:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.419930:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.419933:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135198280/0xefc4487a018788a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419937:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb7ca00/0xefc4487a0187894a lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010c3 expref: 3453 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.419944:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb7ca00, rc 0) 00000100:00100000:0.0:1705683932.419954:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090135f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3453:16443:x1788538641023360:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2265us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.419958:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920761 00010000:00010000:3.0:1705683932.419962:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880135198280 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.419964:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135198280/0xefc4487a018788a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.419978:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e85e400/2, rc 0, transno 380965 00000100:00100000:0.0:1705683932.419983:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e85e400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584504640:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.420006:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fbcb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584506432:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.420010:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135198280/0xefc4487a018788a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.420021:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1705683932.420040:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420045:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420050:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420054:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420065:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.420163:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a665e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3262:3084:x1788538584504896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5180us (5209us total) trans 4295348262 rc 0/0 00010000:00010000:3.0:1705683932.420164:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135198280/0xefc4487a018788a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.420167:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920756 00010000:00010000:0.0:1705683932.420178:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.420179:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420183:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135198280/0xefc4487a018788a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420184:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7d400 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.420185:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420190:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420193:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420194:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420195:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.420197:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420201:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7d400/0xefc4487a018788c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420206:0:15135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420211:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420211:0:15135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420212:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.420212:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420215:0:15135:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420219:0:15135:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.420223:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013713bc00/2, rc 0, transno 380966 00010000:00010000:3.0:1705683932.420226:0:15135:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.420227:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88013713bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584504896:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.420250:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fbe900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584506624:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.420250:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.420251:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.420264:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.420278:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420279:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420282:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584506624 00010000:00010000:3.0:1705683932.420283:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098265b80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.420284:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420292:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.420307:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420308:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420312:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920772 00000100:00100000:0.0:1705683932.420314:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3262:3081:x1788538584506624:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.420317:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420321:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098265b80/0xefc4487a01878919 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.420340:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420341:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.420342:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.420348:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.420349:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.420354:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413403 00002000:00010000:0.0:1705683932.420361:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.420362:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95e3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.420364:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.420365:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95e3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.420366:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95e3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.420378:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fb8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1881:7334:x1788538641024384:12345-192.168.203.41@tcp:101:lfs.0 00000100:00100000:0.0:1705683932.420385:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3263:3081:x1788538584506624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (120us total) trans 4295348263 rc 0/0 00000100:00100000:0.0:1705683932.420389:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920772 00000004:00080000:0.0:1705683932.420407:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a1fbe900/2, rc 0, transno 380967 00010000:00010000:3.0:1705683932.420410:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.420412:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fbe900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584506624:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.420430:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1705683932.420435:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fbee00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584506688:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.420448:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.420458:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420459:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420462:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584506688 00000100:00100000:0.0:1705683932.420470:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420471:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420473:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920773 00000100:00100000:0.0:1705683932.420475:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+3263:3081:x1788538584506688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.420484:0:14216:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34525 count 1 00010000:00010000:3.0:1705683932.420560:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5ed00/0xefc4487a01878997 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010df expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420562:0:14216:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420569:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3998 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420575:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007373e580/0xefc4487a0185a08c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c64 expref: 5957 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420579:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.420580:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.420581:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420593:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007373e580/0xefc4487a0185a08c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c64 expref: 5957 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420600:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007373e580/0xefc4487a0185a08c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c64 expref: 5957 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.420606:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584506752:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.420625:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3998 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420631:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3998 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.420643:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584506816:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.420652:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012cc51c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.420676:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.420698:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.420721:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.420733:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.420739:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.420742:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.420745:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.420748:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420749:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420753:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641024768 00000100:00100000:0.0:1705683932.420763:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420763:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.420766:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920774 00000100:00100000:0.0:1705683932.420768:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:6554:x1788538641024768:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.420773:0:14282:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.420790:0:14282:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a018789ba lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010ed expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420800:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136325180/0xefc4487a0186354c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1cc expref: 4000 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420804:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.420804:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.420806:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a018789ba lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010ed expref: 4000 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.420816:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136325180/0xefc4487a0186354c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1cc expref: 4000 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.420826:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136325180/0xefc4487a0186354c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1cc expref: 4000 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.420832:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584506880:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.420844:0:14282:0:(client.c:2536:ptlrpc_set_wait()) set ffff880134ede0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.420860:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.420893:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420905:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.420906:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.420941:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420952:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420956:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420959:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420961:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5de00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.420963:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420966:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420971:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.420972:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.420973:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420976:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5de00/0xefc4487a018789b3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420984:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420987:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420990:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420992:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5cc80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.420993:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420996:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.420999:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800818b7b00) 00010000:00010000:3.0:1705683932.421000:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.421001:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.421004:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5cc80/0xefc4487a018789c1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.421011:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.421012:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.421019:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413405 00000100:00100000:0.0:1705683932.421023:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1805:7265:x1788538641024576:12345-192.168.203.41@tcp:36:rm.0 00000100:00100000:0.0:1705683932.421033:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.421033:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.421056:0:8825:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1705683932.421066:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7d680/0xefc4487a01878052 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x434d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e15 expref: 1805 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.421095:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013600f700/0xefc4487a0185b156 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x434d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f9690 expref: 1804 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.421102:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x434d:0x0].0x0 (ffff8800a0400400) 00010000:00010000:0.0:1705683932.421106:0:8825:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.421113:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5ed00/0xefc4487a01878997 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010df expref: 1882 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.421114:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.421118:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f5ed00/0xefc4487a01878997 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010df expref: 1882 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.421119:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421123:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.421134:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123f5ed00, rc 0) 00000100:00100000:3.0:1705683932.421144:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fb8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1881:7334:x1788538641024384:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 767us (1250us total) trans 0 rc 301/301 00000100:00100000:3.0:1705683932.421148:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413403 00010000:00010000:0.0:1705683932.421190:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099a64280/0xefc4487a018789cf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42b2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:0.0:1705683932.421195:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099a64280/0xefc4487a018789cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421199:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099a64280/0xefc4487a018789cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421257:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:0.0:1705683932.421263:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421268:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:3.0:1705683932.421319:0:6533:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1788538584505472:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.421347:0:6533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00010000:00100000:3.0:1705683932.421364:0:6533:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.421365:0:6533:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.421365:0:6533:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.421367:0:6533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.421370:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00000004:00080000:0.0:1705683932.421394:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135576e00/2, rc 0, transno 380968 00000100:00100000:0.0:1705683932.421401:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135576e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584506304:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421423:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1705683932.421427:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584507008:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421443:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1705683932.421470:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1624, 64 off125912 00010000:00010000:0.0:1705683932.421496:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:0.0:1705683932.421502:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421507:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421514:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421517:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421520:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e238c80/0xefc4487a018789e4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x434d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421533:0:8825:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1705683932.421541:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421546:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421549:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421552:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e23bc00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.421553:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421557:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421565:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x434d:0x0].0x0 (ffff88012d2bb300) 00010000:00010000:0.0:1705683932.421566:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1705683932.421568:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421571:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23bc00/0xefc4487a018789dd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x434d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.421593:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.421600:0:6533:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.421604:0:6533:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 4/0,1 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.421626:0:6533:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.421630:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.421632:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1845 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.421634:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421637:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00000100:00100000:3.0:1705683932.421638:0:6533:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1788538584507072:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.421641:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421644:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801314eb480 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.421645:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421648:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421653:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:0.0:1705683932.421655:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.421656:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421659:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314eb480/0xefc4487a018789c8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000004:00010000:0.0:1705683932.421666:0:8825:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88009bbf0000 reply state ffff8800872fd000 transno 4295084961 ns: mdt-lustre-MDT0001_UUID lock: ffff880099a64280/0xefc4487a018789cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:3.0:1705683932.421669:0:6533:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.421672:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099a64280/0xefc4487a018789cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x42b2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.421675:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3031 (ffff88012d2bb600) 00010000:00010000:0.0:1705683932.421678:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1705683932.421694:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1805:7265:x1788538641024576:12345-192.168.203.41@tcp:36:rm.0 Request processed in 669us (1017us total) trans 4295084961 rc 0/0 00000100:00100000:0.0:1705683932.421698:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413405 00000004:00080000:0.0:1705683932.421740:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bbf1e00/2, rc 0, transno 380969 00000100:00100000:0.0:1705683932.421745:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584507008:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421765:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1705683932.421770:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf1400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584507136:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421785:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.421855:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090132800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3266:3084:x1788538584505152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5800us (5839us total) trans 4295348266 rc 0/0 00000100:00100000:3.0:1705683932.421859:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920759 00000004:00080000:0.0:1705683932.421861:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090135000/2, rc 0, transno 380970 00000100:00100000:0.0:1705683932.421866:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090135000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584505152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421886:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584507200:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.421900:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.421912:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.421924:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.421928:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584507200 00000100:00100000:3.0:1705683932.421945:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920777 00000100:00100000:3.0:1705683932.421948:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3266:3081:x1788538584507200:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1705683932.422112:0:15135:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.422114:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95e5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.422124:0:15135:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95e5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.422126:0:15135:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95e5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.422127:0:15135:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95e5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1705683932.422178:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bbf2d00/2, rc 0, transno 380971 00000100:00100000:3.0:1705683932.422181:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3267:3081:x1788538584507200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 226us (274us total) trans 4295348267 rc 0/0 00000100:00100000:0.0:1705683932.422184:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584507200:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.422185:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920777 00000100:00100000:0.0:1705683932.422202:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1705683932.422206:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf4600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584507392:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.422221:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.422229:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.422230:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.422233:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584507392 00000100:00100000:3.0:1705683932.422256:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.422257:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.422260:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920778 00000100:00100000:3.0:1705683932.422263:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3267:3081:x1788538584507392:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.422272:0:15135:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34527 count 1 00000100:00100000:0.0:1705683932.422394:0:15145:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135575f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584505920:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.422471:0:15135:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.422480:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 4000 pid: 8803 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.422500:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5957 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.422505:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.422506:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.422507:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.422520:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5957 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.422526:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5957 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.422532:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584507456:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.422573:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 4000 pid: 8803 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.422579:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 4000 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.422587:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efdf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584507520:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.422601:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097eff300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584505856:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.422605:0:15145:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135570f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584506048:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.422607:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584505984:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.422617:0:15145:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.422617:0:15188:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.422622:0:15145:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.422622:0:15145:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.422622:0:15188:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.422622:0:15188:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.422623:0:15145:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.422623:0:15188:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.422634:0:15220:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090131400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_107:lustre-OST0001_UUID:15220:1788538584506176:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.422640:0:15220:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fbad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_107:lustre-OST0001_UUID:15220:1788538584506240:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.422641:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2baa80 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.422652:0:15220:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.422657:0:15220:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.422657:0:15220:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.422658:0:15220:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.422733:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584506368:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.422741:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.422753:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:1855:x1788538641024128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2971us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.422758:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332917 00000100:00100000:0.0:1705683932.423144:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423167:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423176:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423186:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423197:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423207:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423217:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423218:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423223:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641024960 00010000:00010000:0.0:1705683932.423232:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d349900/0xefc4487a0185a04d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c3a expref: 5958 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.423243:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423243:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423246:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025088 00010000:00010000:0.0:1705683932.423251:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d12a80/0xefc4487a0185a03f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c2c expref: 5959 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.423260:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423261:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423264:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332923 00000100:00100000:0.0:1705683932.423267:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1854:x1788538641025152:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.423274:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.423276:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0122f80/0xefc4487a01807006 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f01 expref: 4002 pid: 15142 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423282:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0122f80/0xefc4487a01807006 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f01 expref: 4002 pid: 15142 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423290:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0122f80/0xefc4487a01807006 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f01 expref: 4002 pid: 15142 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423297:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.423313:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:1854:x1788538641025152:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.423318:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332923 00000100:00100000:0.0:1705683932.423326:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423327:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423330:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332925 00000100:00100000:0.0:1705683932.423333:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5960:1857:x1788538641024960:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.423338:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.423340:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d349900/0xefc4487a0185a04d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c3a expref: 5960 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423346:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d349900/0xefc4487a0185a04d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c3a expref: 5960 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423356:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d349900/0xefc4487a0185a04d lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c3a expref: 5960 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423364:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423365:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423367:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423370:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423382:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.423395:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:1857:x1788538641024960:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.423399:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332925 00000100:00100000:0.0:1705683932.423407:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423407:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423410:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332928 00000100:00100000:0.0:1705683932.423413:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5957:1854:x1788538641025280:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.423418:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.423421:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5957 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423430:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5956 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423439:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d10780/0xefc4487a0185a046 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c48 expref: 5956 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423447:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423448:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423449:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423454:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423465:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.423476:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf5000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1854:x1788538641025280:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.423481:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332928 00010000:00010000:0.0:1705683932.423500:0:15145:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423505:0:15145:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423510:0:15145:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423518:0:15145:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423527:0:15145:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1705683932.423615:0:15145:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+3268:3084:x1788538584505728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4731us (4773us total) trans 4295348269 rc 0/0 00000100:00100000:0.0:1705683932.423620:0:15145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920766 00010000:00010000:3.0:1705683932.423653:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1705683932.423656:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423662:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb7cc80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.423663:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423668:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423677:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423680:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb7cc80/0xefc4487a01878974 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423693:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.423694:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423698:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880099aa2080 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.423703:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.423725:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.423728:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e285000/2, rc 0, transno 380973 00010000:00010000:3.0:1705683932.423730:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.423733:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009e285000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584505728:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.423738:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423742:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099aa2080/0xefc4487a01878966 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.423753:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.423753:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.423754:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.423755:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584507648:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.423770:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.423770:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.423783:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423784:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423789:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025024 00010000:00010000:0.0:1705683932.423798:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f5f200/0xefc4487a01847a1c lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc85 expref: 3453 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.423809:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423809:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423813:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332929 00000100:00100000:0.0:1705683932.423816:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3453:1857:x1788538641025024:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.423821:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.423825:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.423829:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f5f200/0xefc4487a01847a1c lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc85 expref: 3453 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423839:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f5f200/0xefc4487a01847a1c lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc85 expref: 3453 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.423846:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.423849:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f5f200/0xefc4487a01847a1c lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc85 expref: 3453 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.423857:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423858:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.423860:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099aa0280/0xefc4487a01878958 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010ca expref: 3533 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.423865:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099aa0280/0xefc4487a01878958 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010ca expref: 3533 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.423875:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.423878:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099aa0280/0xefc4487a01878958 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010ca expref: 3533 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.423885:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584507712:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.423898:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.423906:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423907:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423958:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025408 00010000:00010000:0.0:1705683932.423967:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c66800/0xefc4487a0185a054 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c56 expref: 5955 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.423977:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423978:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423981:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025216 00010000:00010000:0.0:1705683932.423986:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd5d680/0xefc4487a01806fe3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ee5 expref: 3997 pid: 15136 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.423994:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423994:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.423997:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332930 00000100:00100000:0.0:1705683932.424000:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1854:x1788538641025408:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.424005:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.424007:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c66800/0xefc4487a0185a054 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c56 expref: 5955 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.424013:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c66800/0xefc4487a0185a054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c56 expref: 5955 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.424023:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c66800/0xefc4487a0185a054 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c56 expref: 5955 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.424025:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.424031:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.424032:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.424033:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.424035:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.424036:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.424037:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.424040:0:14205:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025536 00010000:00010000:0.0:1705683932.424049:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.424053:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.424054:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.424058:0:14205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413407 00000100:00100000:0.0:1705683932.424061:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5954:1854:x1788538641025408:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.424061:0:14205:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1921:7299:x1788538641025536:12345-192.168.203.41@tcp:101:mrename.0 00000100:00100000:0.0:1705683932.424065:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332930 00010000:00010000:3.0:1705683932.424107:0:14205:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.424112:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424113:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.424115:0:14205:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878a07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x121:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010fb expref: -99 pid: 14205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.424116:0:15145:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025600 00000100:00100000:0.0:1705683932.424125:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424126:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424130:0:15145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920781 00000100:00100000:0.0:1705683932.424132:0:15145:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:6496:x1788538641025600:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.424137:0:15145:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.424232:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d180/0xefc4487a01878a0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x121:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:3.0:1705683932.424238:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d180/0xefc4487a01878a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 00010000:00010000:3.0:1705683932.424242:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d180/0xefc4487a01878a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x121:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 00000004:00200000:3.0:1705683932.424302:0:14205:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000401:0x121:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.424306:0:14205:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1705683932.424343:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5c500/0xefc4487a01878a07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x121:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010fb expref: 1923 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424384:0:14205:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d5d180/0xefc4487a01878a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x121:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010fb expref: 1922 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.424396:0:15145:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01878a15 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9207:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3010f4 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424401:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x121:0x0].0x0 (ffff88009b8de400) 00010000:00010000:3.0:1705683932.424402:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1705683932.424404:0:14205:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d5d180, rc 0) 00002000:00010000:0.0:1705683932.424406:0:15145:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9207:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.424414:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.424415:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.424418:0:15145:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01878a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010f4 expref: 3997 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.424424:0:15145:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e238780/0xefc4487a01878a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010f4 expref: 3997 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.424430:0:15145:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e238780, rc 0) 00000100:00100000:0.0:1705683932.424459:0:15145:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:6496:x1788538641025600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 325us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.424459:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1922:7299:x1788538641025536:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 397us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.424463:0:15145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920781 00000100:00100000:3.0:1705683932.424487:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413407 00010000:00010000:3.0:1705683932.424530:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.424532:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424538:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800984aaf80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.424539:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424544:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.424554:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a1fbcb00/2, rc 0, transno 380975 00000100:00100000:0.0:1705683932.424557:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fbcb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584506432:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.424562:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424566:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984aaf80/0xefc4487a0187897b lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424575:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.424576:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.424576:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.424581:0:15188:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424586:0:15188:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.424590:0:15188:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.424593:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1705683932.424598:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dcb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584508032:0@lo:2:osp-syn-1-1.0 00080000:00000400:2.0:1705683932.424614:0:14255:0:(osd_handler.c:1989:osd_trans_dump_creds()) write: 13/22/23, punch: 0/0/0, quota 1/3/3 00000100:00100000:0.0:1705683932.424615:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.424627:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424628:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.424628:0:15188:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5c280/0xefc4487a0187895f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.424632:0:15145:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584508032 00000100:00100000:0.0:1705683932.424643:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424643:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424647:0:15145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920783 00000100:00100000:0.0:1705683932.424649:0:15145:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+3272:3084:x1788538584508032:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.424697:0:15145:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95e8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.424699:0:15145:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95e8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.424701:0:15145:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95e8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.424702:0:15145:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95e8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.424703:0:15145:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95e8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.424736:0:15145:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+3273:3084:x1788538584508032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 85us (120us total) trans 4295348273 rc 0/0 00000100:00100000:0.0:1705683932.424741:0:15145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920783 00000004:00080000:0.0:1705683932.424775:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801315dcb00/2, rc 0, transno 380977 00000100:00100000:0.0:1705683932.424781:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dcb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584508032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.424810:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315df300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584508096:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.424811:0:15188:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.424826:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.424839:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424840:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424843:0:15145:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584508096 00000100:00100000:0.0:1705683932.424854:0:15145:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424854:0:15145:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.424857:0:15145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920785 00000100:00100000:0.0:1705683932.424860:0:15145:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+3273:3084:x1788538584508096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.424870:0:15145:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34530 count 1 00010000:00010000:0.0:1705683932.424967:0:15145:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.424975:0:15145:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3996 pid: 15140 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.424999:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e283200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3274:3081:x1788538584505536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6371us (6476us total) trans 4295348274 rc 0/0 00000100:00100000:3.0:1705683932.425006:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920764 00010000:00010000:0.0:1705683932.425029:0:15145:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5953 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.425033:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.425034:0:15145:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.425036:0:15145:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425049:0:15145:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5953 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.425055:0:15145:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5953 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.425061:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.425062:0:15145:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584508352:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.425098:0:15145:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3996 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.425106:0:15145:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3996 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.425117:0:15145:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584508416:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.425150:0:15145:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c300 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.425169:0:14216:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007373e580/0xefc4487a0185a08c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c64 expref: 5953 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.425184:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584506752:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.425193:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584506816:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.425195:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.425205:0:14216:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.425209:0:14216:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.425210:0:14216:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.425211:0:14216:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425224:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584506880:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.425235:0:14282:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314eb200/0xefc4487a018789ba lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x951b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010ed expref: 3997 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425242:0:14282:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314eb200, rc 0) 00000100:00100000:0.0:1705683932.425251:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:6554:x1788538641024768:12345-192.168.203.41@tcp:101:dd.0 Request processed in 4482us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.425256:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920774 00000100:00100000:0.0:1705683932.425264:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425265:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425268:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584508288 00000100:00100000:3.0:1705683932.425268:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.425295:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425297:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425301:0:15241:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025728 00010000:00010000:0.0:1705683932.425309:0:15241:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3996 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.425311:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.425312:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.425325:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920786 00000100:00100000:0.0:1705683932.425328:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425329:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.425329:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b20500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3274:3081:x1788538584508288:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.425331:0:15241:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332934 00000100:00100000:0.0:1705683932.425334:0:15241:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1857:x1788538641025728:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.425339:0:15241:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.425342:0:15241:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3996 pid: 15181 timeout: 805 lvb_type: 1 00002000:00080000:3.0:1705683932.425346:0:15188:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34531 count 1 00010000:00010000:0.0:1705683932.425347:0:15241:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3996 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.425357:0:15241:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f6800/0xefc4487a01807053 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f55 expref: 3996 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.425363:0:15241:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.425364:0:15241:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.425365:0:15241:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425369:0:15241:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425382:0:15241:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.425393:0:15241:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1857:x1788538641025728:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.425398:0:15241:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332934 00010000:00010000:0.0:1705683932.425410:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.425412:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425417:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801314eaa80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.425418:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425423:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425431:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425434:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801314eaa80/0xefc4487a0187899e lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425446:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.425447:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.425448:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.425466:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.425474:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425474:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425478:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025856 00000100:00100000:0.0:1705683932.425488:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425489:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425492:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920787 00000100:00100000:0.0:1705683932.425495:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3453:16415:x1788538641025856:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.425500:0:14282:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.425509:0:15188:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.425517:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3994 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.425521:0:15188:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007373d680/0xefc4487a0185a077 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8cb8 expref: 5952 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.425524:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.425525:0:15188:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.425526:0:15188:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.425548:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007373d680/0xefc4487a0185a077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8cb8 expref: 5952 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.425563:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007373d680/0xefc4487a0185a077 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8cb8 expref: 5952 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.425579:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584508608:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.425595:0:15188:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3994 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.425624:0:15188:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3994 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.425630:0:15188:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584508672:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.425649:0:15188:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2bae40 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.425687:0:14282:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e23b700/0xefc4487a01878a31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301102 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425701:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135883980/0xefc4487a0181e193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9751 expref: 3533 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425706:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.425707:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.425719:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e23b700/0xefc4487a01878a31 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301102 expref: 3454 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425732:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135883980/0xefc4487a0181e193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9751 expref: 3533 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.425737:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135883980/0xefc4487a0181e193 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9751 expref: 3533 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.425745:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:14282:1788538584508800:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.425755:0:14282:0:(client.c:2536:ptlrpc_set_wait()) set ffff880134ede0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.425798:0:6533:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efb700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1788538584507072:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.425822:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425846:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.425847:0:6533:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425851:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425864:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.425864:0:6533:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425867:0:6533:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880132328280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.425869:0:6533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425873:0:6533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425878:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4123:0x0].0x0 (ffff8800a114ae00) 00000100:00100000:0.0:1705683932.425880:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.425880:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.425882:0:6533:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425886:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425887:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425891:0:15241:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026176 00010000:00010000:3.0:1705683932.425897:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132328280/0xefc4487a01878951 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x4123:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.425900:0:15241:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5954 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.425906:0:6533:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425909:0:6533:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425913:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425914:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425915:0:15241:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026048 00010000:00010000:0.0:1705683932.425920:0:15241:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d13c00/0xefc4487a0185a05b lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c72 expref: 5955 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.425925:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425928:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425929:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425932:0:15241:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332935 00000100:00100000:0.0:1705683932.425934:0:15241:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1854:x1788538641026176:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.425935:0:6533:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425938:0:6533:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098264780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.425939:0:15241:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.425940:0:6533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.425941:0:15241:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5955 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.425943:0:6533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.425946:0:15241:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5955 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.425948:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:3.0:1705683932.425950:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.425951:0:6533:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 3/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.425954:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098264780/0xefc4487a0187893c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.425955:0:15241:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.425966:0:15241:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1854:x1788538641026176:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 30us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.425970:0:15241:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332935 00000004:00010000:3.0:1705683932.425974:0:6533:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880135575a00 reply state ffff88008ef86000 transno 4295091440 ns: mdt-lustre-MDT0000_UUID lock: ffff88013232af80/0xefc4487a01878943 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425976:0:15241:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425977:0:15241:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.425980:0:15241:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332936 00010000:00010000:3.0:1705683932.425980:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013232af80/0xefc4487a01878943 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x40bb:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.425982:0:15241:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315de900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5954:1854:x1788538641026048:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.425984:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x3731 (ffff8800a627cf00) 00010000:00010000:0.0:1705683932.425986:0:15241:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.425989:0:15241:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d13c00/0xefc4487a0185a05b lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c72 expref: 5954 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.425994:0:15241:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d13c00/0xefc4487a0185a05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c72 expref: 5954 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.425997:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.426003:0:15241:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.426012:0:15241:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315de900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5954:1854:x1788538641026048:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 29us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.426017:0:15241:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332936 00000100:00100000:3.0:1705683932.426021:0:6533:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1922:7185:x1788538641023424:12345-192.168.203.41@tcp:36:rm.0 Request processed in 8327us (8424us total) trans 4295091440 rc 0/0 00000100:00100000:3.0:1705683932.426026:0:6533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413401 00000100:00100000:0.0:1705683932.426051:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426058:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426058:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426062:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026112 00010000:00010000:0.0:1705683932.426069:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2f8f00/0xefc4487a0180706f lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f71 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.426074:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973f4280/0xefc4487a0185a062 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c80 expref: 5954 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.426090:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426091:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426095:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332937 00000100:00100000:0.0:1705683932.426098:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4293850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1857:x1788538641026112:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.426104:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.426106:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2f8f00/0xefc4487a0180706f lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f71 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.426106:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584507456:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.426111:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2f8f00/0xefc4487a0180706f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f71 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.426122:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efdf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584507520:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.426125:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.426125:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.426127:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426131:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426139:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.426141:0:15135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.426146:0:15135:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.426147:0:15135:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.426147:0:15135:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426150:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4293850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1857:x1788538641026112:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 51us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.426155:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332937 00000100:00100000:3.0:1705683932.426183:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426206:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426207:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426211:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641025984 00010000:00010000:0.0:1705683932.426219:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1846 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.426229:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426230:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426233:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332938 00000100:00100000:0.0:1705683932.426235:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1846:1857:x1788538641025984:12345-192.168.203.41@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1705683932.426241:0:15238:0:(ldlm_lockd.c:1696:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1846 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.426246:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x58/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1846 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.426255:0:15238:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x18/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1846 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.426259:0:15238:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4123:0x0].0x0 (ffff8800a114ae00) 00010000:00010000:0.0:1705683932.426260:0:15238:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 58 00010000:00010000:0.0:1705683932.426261:0:15238:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 2/0,1 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.426265:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40090080000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.426268:0:15238:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40090080000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426273:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.426275:0:15238:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426275:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426278:0:15238:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426280:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800984a9180 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.426282:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426284:0:15238:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.426286:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426293:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426321:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984a9180/0xefc4487a018789f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426331:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.426333:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426336:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880123f5c500 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.426337:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.426340:0:15238:0:(ldlm_lockd.c:1744:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca52580/0xefc4487a01822230 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000010000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da47f expref: 1846 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.426340:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426345:0:11072:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4123:0x0].0x0 (ffff8800a114ae00) 00010000:00010000:3.0:1705683932.426347:0:11072:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1705683932.426348:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 1/0,0 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426351:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123f5c500/0xefc4487a018789eb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x4123:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 00000100:00100000:0.0:1705683932.426355:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1846:1857:x1788538641025984:12345-192.168.203.41@tcp:102:ldlm_bl.0 Request processed in 119us (173us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.426356:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.426357:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.426358:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.426359:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332938 00010000:00010000:3.0:1705683932.426362:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.426375:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b23700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584508992:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.426375:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426390:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.426395:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426402:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.426402:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426403:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426405:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026240 00010000:00010000:0.0:1705683932.426413:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 3994 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.426419:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426422:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426423:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426425:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332939 00000100:00100000:0.0:1705683932.426428:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:1857:x1788538641026240:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.426430:0:6533:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026496 00010000:00010000:0.0:1705683932.426433:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.426435:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 3994 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.426440:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.426441:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 3994 pid: 8803 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.426441:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.426444:0:6533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413408 00000100:00100000:3.0:1705683932.426446:0:6533:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efb700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1882:7327:x1788538641026496:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:0.0:1705683932.426451:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2f9e00/0xefc4487a018070a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1f8d expref: 3994 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.426457:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.426458:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.426459:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426463:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426475:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.426488:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3993:1857:x1788538641026240:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.426492:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332939 00000100:00100000:0.0:1705683932.426516:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426531:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426542:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426553:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426563:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.426583:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584507712:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.426593:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.426603:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3454:1857:x1788538641025024:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2787us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.426607:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332929 00010000:00010000:3.0:1705683932.426611:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.426625:0:6533:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1882 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426629:0:6533:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.426631:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426631:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426636:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026432 00010000:00010000:3.0:1705683932.426642:0:6533:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1883 pid: 14418 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.426649:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426650:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426653:0:14418:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026624 00010000:00010000:3.0:1705683932.426657:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1884 pid: 14418 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.426660:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426661:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426662:0:14418:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026560 00000100:00100000:3.0:1705683932.426665:0:6533:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1788538584509120:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.426668:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426668:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426670:0:14418:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026816 00000100:00100000:0.0:1705683932.426676:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426677:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426680:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413409 00000100:00100000:0.0:1705683932.426683:0:14418:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315da800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1885:7342:x1788538641026432:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:0.0:1705683932.426689:0:14418:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.426689:0:6533:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2baa80 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.426695:0:14418:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01878a54 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x4259:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301110 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.426696:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.426697:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.426702:0:6532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413410 00000100:00100000:3.0:1705683932.426729:0:6532:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7338:x1788538641026624:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.426736:0:6532:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.426737:0:6532:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1705683932.426742:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1886 pid: 14418 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.426750:0:6532:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.426752:0:6532:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.426756:0:6532:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.426760:0:6532:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.426767:0:6532:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.426797:0:6532:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5ed00/0xefc4487a01878a5b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301117 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426844:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01878a54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4259:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301110 expref: 1888 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426852:0:14418:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23b980/0xefc4487a01878a54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4259:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301110 expref: 1888 pid: 14418 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.426862:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4259:0x0].0x0 (ffff88009ca80d00) 00010000:00010000:0.0:1705683932.426864:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1705683932.426865:0:14418:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e23b980, rc 0) 00000100:00100000:0.0:1705683932.426876:0:14418:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315da800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1888:7342:x1788538641026432:12345-192.168.203.41@tcp:101:touch.0 Request processed in 192us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.426880:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413409 00010000:00010000:3.0:1705683932.426890:0:6532:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 00010000:00010000:3.0:1705683932.426896:0:6532:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801315c5900/0xefc4487a0186d7cd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe04f expref: 1805 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426901:0:6532:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007359d400/0xefc4487a018703b0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fec26 expref: 1805 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426905:0:6532:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1888 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426910:0:6532:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 6/0,1 mode: --/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 00010000:00010000:3.0:1705683932.426922:0:6532:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1888 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426927:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1887 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.426929:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426930:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.426933:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413412 00000100:00100000:3.0:1705683932.426933:0:6532:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509312:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.426936:0:14418:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1805:7265:x1788538641026816:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:0.0:1705683932.426953:0:14418:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.426961:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7db80/0xefc4487a01878075 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e1c expref: 1805 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426963:0:6532:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007359d400/0xefc4487a018703b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fec26 expref: 1805 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.426969:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007359d400/0xefc4487a018703b0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fec26 expref: 1804 pid: 6531 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.426971:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41bf:0x0].0x0 (ffff88008747e800) 00010000:00010000:0.0:1705683932.426972:0:14418:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.426980:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00000100:00100000:3.0:1705683932.426983:0:6532:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509376:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.426985:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.426991:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.426997:0:6532:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801315c5900/0xefc4487a0186d7cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe04f expref: 1804 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.427001:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801315c5900/0xefc4487a0186d7cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe04f expref: 1804 pid: 14222 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.427006:0:6532:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509440:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.427025:0:6532:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.427046:0:15135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.427051:0:15135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.427052:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01878a7e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42b2:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:3.0:1705683932.427055:0:15135:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.427057:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01878a7e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.427059:0:15135:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123f5e580/0xefc4487a018789f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.427061:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01878a7e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.427111:0:15135:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1705683932.427112:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:0.0:1705683932.427117:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427121:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00000040:00080000:0.0:1705683932.427222:0:14418:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1625, 64 off125976 00010000:00010000:0.0:1705683932.427312:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:0.0:1705683932.427318:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427323:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427326:0:14418:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427332:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427335:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.427359:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3279:3081:x1788538584507392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5094us (5136us total) trans 4295348279 rc 0/0 00000100:00100000:3.0:1705683932.427364:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920778 00010000:00010000:0.0:1705683932.427386:0:14418:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1705683932.427395:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427399:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427402:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427405:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880099fcdb80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.427407:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427410:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427415:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41bf:0x0].0x0 (ffff88008747e800) 00010000:00010000:0.0:1705683932.427416:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1705683932.427417:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427420:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcdb80/0xefc4487a01878a85 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.427489:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427490:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427494:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584509568 00000100:00100000:3.0:1705683932.427506:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427507:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427510:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920794 00000100:00100000:3.0:1705683932.427513:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3279:3081:x1788538584509568:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.427520:0:14418:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427527:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427530:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427534:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427537:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e239400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.427538:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427542:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427548:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x0 (ffff880098277800) 00010000:00010000:0.0:1705683932.427549:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.427551:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427554:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e239400/0xefc4487a01878a77 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00000004:00010000:0.0:1705683932.427559:0:14418:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8801315d9e00 reply state ffff88008180c000 transno 4295084962 ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01878a7e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427565:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e23a080/0xefc4487a01878a7e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x42b2:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427568:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b2:0x0].0x3431 (ffff8800a1659c00) 00010000:00010000:0.0:1705683932.427570:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1705683932.427586:0:14418:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1806:7265:x1788538641026816:12345-192.168.203.41@tcp:36:rm.0 Request processed in 648us (1022us total) trans 4295084962 rc 0/0 00000100:00100000:0.0:1705683932.427590:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413412 00010000:00010000:0.0:1705683932.427605:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.427607:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427611:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880099fcd180 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.427613:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427616:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427621:0:8828:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41bf:0x0].0x0 (ffff88008747e800) 00010000:00010000:0.0:1705683932.427622:0:8828:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1705683932.427623:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427626:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcd180/0xefc4487a01878a93 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x41bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.427632:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.427633:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.427634:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.427672:0:15135:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95eb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.427674:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95eb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.427675:0:15135:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.427676:0:15135:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95eb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.427677:0:15135:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95eb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.427741:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.427744:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:lustre-MDT0001-mdtlov_UUID+3280:3081:x1788538584509568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 230us (351us total) trans 4295348280 rc 0/0 00000100:00100000:3.0:1705683932.427781:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920794 00000100:00100000:3.0:1705683932.427801:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427802:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427805:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641026880 00000100:00100000:3.0:1705683932.427819:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427820:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.427824:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920795 00000100:00100000:3.0:1705683932.427826:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3993:4708:x1788538641026880:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.427832:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.427915:0:15145:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584508352:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.427940:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.427947:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.427948:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.427952:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027008 00010000:00010000:0.0:1705683932.427960:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801332a2f80/0xefc4487a0180730f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fa9 expref: 3994 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.427960:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878a9a lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30112c expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.427970:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.427970:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.427971:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800959abc00/0xefc4487a01847a23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc8c expref: 5953 pid: 15148 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.427973:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332940 00000100:00100000:0.0:1705683932.427976:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1856:x1788538641027008:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.427976:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.427980:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.427982:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801332a2f80/0xefc4487a0180730f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fa9 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.427987:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.427988:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801332a2f80/0xefc4487a0180730f lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fa9 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.427988:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878a9a lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30112c expref: 3995 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.427996:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332a2f80/0xefc4487a0180730f lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fa9 expref: 3995 pid: 8803 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.428000:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800959abc00/0xefc4487a01847a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc8c expref: 5953 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.428003:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.428005:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800959abc00/0xefc4487a01847a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc8c expref: 5953 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.428014:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:1856:x1788538641027008:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 37us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.428019:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332940 00000100:00100000:3.0:1705683932.428025:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584509696:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.428061:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.428179:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.428210:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.428242:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428243:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428252:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584508608:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.428257:0:15145:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:15145:1788538584508416:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.428269:0:15145:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.428274:0:15145:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.428275:0:15145:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.428276:0:15145:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428282:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428282:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428286:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027264 00000100:00100000:0.0:1705683932.428313:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.428334:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428335:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.428351:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920797 00000100:00100000:3.0:1705683932.428355:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3533:6496:x1788538641027264:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.428366:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.428373:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.428373:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.428374:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428377:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027072 00010000:00010000:0.0:1705683932.428385:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133119900/0xefc4487a0185a070 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c9c expref: 5954 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.428393:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428394:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428396:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332943 00000100:00100000:0.0:1705683932.428398:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5954:1856:x1788538641027072:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.428402:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.428404:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133119900/0xefc4487a0185a070 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c9c expref: 5954 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428409:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133119900/0xefc4487a0185a070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c9c expref: 5954 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428418:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133119900/0xefc4487a0185a070 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8c9c expref: 5954 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428424:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.428425:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.428427:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428431:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428442:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.428454:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:1856:x1788538641027072:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.428459:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332943 00000100:00100000:0.0:1705683932.428482:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.428488:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428489:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428492:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027200 00010000:00010000:0.0:1705683932.428498:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5952 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.428506:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428507:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428509:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332944 00000100:00100000:0.0:1705683932.428511:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:1856:x1788538641027200:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.428568:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.428571:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5952 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428620:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5952 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428627:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973f7700/0xefc4487a0185a07e lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8caa expref: 5952 pid: 15097 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.428635:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.428637:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984a8f00/0xefc4487a01878a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428655:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800984a8f00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.428657:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984a8f00/0xefc4487a01878a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428662:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984a8f00/0xefc4487a01878a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428671:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984a8f00/0xefc4487a01878a00 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428674:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.428675:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984a8f00/0xefc4487a01878a00 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428689:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.428690:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.428705:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.428723:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a15ce800/0xefc4487a01878aa8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301133 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.428733:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.428734:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5951:1856:x1788538641027200:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 221us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.428739:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332944 00010000:00010000:3.0:1705683932.428741:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.428742:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.428744:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a15ce800/0xefc4487a01878aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301133 expref: 3534 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428769:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a15ce800/0xefc4487a01878aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301133 expref: 3534 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428774:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15ce800, rc 0) 00000100:00100000:3.0:1705683932.428788:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3534:6496:x1788538641027264:12345-192.168.203.41@tcp:101:dd.0 Request processed in 433us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.428792:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920797 00000100:00100000:3.0:1705683932.428846:0:15188:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:15188:1788538584508672:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.428867:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.428876:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428876:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428880:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027328 00010000:00010000:3.0:1705683932.428882:0:15188:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.428886:0:15188:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.428887:0:15188:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00010000:0.0:1705683932.428888:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3992 pid: 15140 timeout: 805 lvb_type: 1 00010000:00100000:3.0:1705683932.428888:0:15188:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428897:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428898:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.428901:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332945 00000100:00100000:0.0:1705683932.428903:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1856:x1788538641027328:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.428908:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.428910:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3992 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428916:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3992 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428926:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f7c00/0xefc4487a018070ed lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1fe1 expref: 3992 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.428933:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.428934:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.428935:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428943:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.428948:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.428954:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.428966:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:1856:x1788538641027328:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 62us (99us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.428967:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.428970:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.428971:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332945 00010000:00010000:3.0:1705683932.428974:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800984ab980 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.428976:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428983:0:15145:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428988:0:15145:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428990:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428992:0:15145:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.428996:0:15145:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.428997:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429001:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ab980/0xefc4487a01878a1c lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429004:0:15145:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.429022:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.429024:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429028:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009e23b480 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.429029:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429034:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429057:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429061:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e23b480/0xefc4487a01878a23 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.429096:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.429098:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.429099:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.429107:0:15145:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+3284:3084:x1788538584508096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4245us (4280us total) trans 4295348283 rc 0/0 00000100:00100000:0.0:1705683932.429112:0:15145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920785 00000100:00100000:3.0:1705683932.429127:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.429135:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:14282:1788538584508800:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.429147:0:14282:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e23b700/0xefc4487a01878a31 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301102 expref: 3453 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429155:0:14282:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e23b700, rc 0) 00000100:00100000:0.0:1705683932.429161:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429162:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.429163:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.429167:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027520 00010000:00010000:0.0:1705683932.429174:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135883980/0xefc4487a0181e193 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9751 expref: 3534 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.429183:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429184:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429186:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027456 00010000:00010000:0.0:1705683932.429192:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3991 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.429200:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429201:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.429201:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.429204:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332948 00000100:00100000:0.0:1705683932.429206:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:1856:x1788538641027456:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.429211:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.429213:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3991 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.429216:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.429219:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3991 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.429229:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a62f5680/0xefc4487a01807117 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d1ffd expref: 3991 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.429240:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.429241:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.429242:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429246:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429262:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.429274:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:1856:x1788538641027456:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.429279:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332948 00000100:00100000:3.0:1705683932.429284:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.429293:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429294:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.429296:0:15188:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.429297:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584510144 00010000:00010000:3.0:1705683932.429301:0:15188:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.429306:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429307:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429310:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027584 00010000:00010000:3.0:1705683932.429315:0:15188:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.429317:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429318:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429319:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027648 00010000:00010000:3.0:1705683932.429320:0:15188:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.429326:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.429326:0:15188:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.429327:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429329:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920800 00000100:00100000:0.0:1705683932.429332:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fba800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3284:3081:x1788538584510144:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.429340:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34536 count 1 00010000:00010000:0.0:1705683932.429423:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429431:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3989 pid: 15121 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.429436:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013311ad00/0xefc4487a0185a0d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d13 expref: 5949 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.429440:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.429441:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.429442:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429454:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013311ad00/0xefc4487a0185a0d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d13 expref: 5949 pid: 15097 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.429460:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013311ad00/0xefc4487a0185a0d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d13 expref: 5949 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.429460:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b20500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3285:3081:x1788538584508288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4121us (4409us total) trans 4295348285 rc 0/0 00000100:00100000:3.0:1705683932.429465:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920786 00000100:00100000:0.0:1705683932.429466:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584510400:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.429473:0:15188:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.429474:0:15188:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.429477:0:15188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920803 00010000:00010000:0.0:1705683932.429482:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3989 pid: 15121 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.429488:0:15188:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3284:3083:x1788538584510272:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.429489:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3989 pid: 15121 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.429494:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584510464:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.429503:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c300 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.429512:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.429514:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429519:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5fc00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.429520:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429525:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429532:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429536:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d5fc00/0xefc4487a01878a2a lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.429553:0:15188:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95ed:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1705683932.429555:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.429555:0:15188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95ed:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:0.0:1705683932.429556:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.429556:0:15188:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95ed:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1705683932.429557:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1705683932.429557:0:15188:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.429558:0:15188:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95ed:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.429569:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3454:16415:x1788538641025856:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 4073us (4102us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.429573:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920787 00000100:00100000:0.0:1705683932.429584:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429585:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429589:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027712 00000100:00100000:3.0:1705683932.429594:0:15188:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+3285:3083:x1788538584510272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 114us (287us total) trans 4295348286 rc 0/0 00000100:00100000:3.0:1705683932.429598:0:15188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920803 00000100:00100000:0.0:1705683932.429601:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429602:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429606:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413413 00000100:00100000:0.0:1705683932.429608:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1806:7185:x1788538641027712:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:0.0:1705683932.429616:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.429623:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c4f00/0xefc4487a01878acb lrc: 2/0,0 mode: --/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301148 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429664:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:0.0:1705683932.429670:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:3.0:1705683932.429672:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.429675:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429755:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.429759:0:6533:0:(ldlm_lockd.c:793:ldlm_handle_ast_error()) ### client (nid 192.168.203.41@tcp) returned -22 from blocking AST (req@ffff880097ef8500 x1788538584509120) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1887 pid: 14418 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.429761:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429765:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.429781:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800984a9e00/0xefc4487a018789a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010e6 expref: 1887 pid: 14418 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.429787:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:3.0:1705683932.429789:0:6533:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1788538584509120:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.429792:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429796:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00010000:0.0:1705683932.429805:0:14222:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.429808:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.429811:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429814:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429818:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.429818:0:6533:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.429821:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.429822:0:6533:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.429824:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800875c6580 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.429826:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.429826:0:6533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00010000:00010000:0.0:1705683932.429829:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00100000:3.0:1705683932.429830:0:6533:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.429830:0:6533:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.429831:0:6533:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.429832:0:6533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00010000:00010000:0.0:1705683932.429833:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x0 (ffff88012b17cc00) 00010000:00010000:0.0:1705683932.429835:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.429835:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00010000:00010000:0.0:1705683932.429836:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429839:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6580/0xefc4487a01878ad2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429845:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429849:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429852:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429854:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800875c6a80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.429855:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429858:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429861:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x35 (ffff88009ca80800) 00010000:00010000:0.0:1705683932.429863:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.429864:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429867:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c6a80/0xefc4487a01878ad9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.429889:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800875c4f00/0xefc4487a01878acb lrc: 0/0,0 mode: --/CR res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301148 expref: 1808 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429898:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301148 expref: 1807 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429902:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff880135984700) 00010000:00010000:0.0:1705683932.429903:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1705683932.429904:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801333d9180, rc 0) 00000100:00100000:0.0:1705683932.429914:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1807:7185:x1788538641027712:12345-192.168.203.41@tcp:101:rm.0 Request processed in 305us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.429918:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413413 00000100:00100000:0.0:1705683932.429925:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429926:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429929:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027840 00000100:00100000:0.0:1705683932.429938:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429938:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.429942:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413414 00000100:00100000:0.0:1705683932.429945:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efda00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1807:7299:x1788538641027840:12345-192.168.203.41@tcp:36:mrename.0 00010000:00010000:0.0:1705683932.429960:0:14222:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1705683932.429967:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d560f00/0xefc4487a018788e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3010a0 expref: 1807 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429985:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x421b:0x0].0x0 (ffff8801358dbf00) 00010000:00010000:0.0:1705683932.429991:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0112580/0xefc4487a01877dce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300d20 expref: 1806 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.429997:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff880099eddc00) 00010000:00010000:0.0:1705683932.429999:0:14222:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.430037:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cde00/0xefc4487a01878aee lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:0.0:1705683932.430040:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:0.0:1705683932.430045:0:14222:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.430049:0:14222:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.430055:0:14222:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.430061:0:14222:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00100000:0.0:1705683932.430064:0:14222:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.430065:0:14222:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.430065:0:14222:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.430065:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cde00/0xefc4487a01878aee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.430152:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.430160:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00080000:00000400:2.0:1705683932.430160:0:14255:0:(osd_handler.c:1996:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00000100:00100000:0.0:1705683932.430161:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430165:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641027968 00010000:00010000:0.0:1705683932.430174:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f102800/0xefc4487a018073e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2035 expref: 3990 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.430183:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cde00/0xefc4487a01878aee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.430184:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430185:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430188:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332949 00000100:00100000:0.0:1705683932.430190:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:1857:x1788538641027968:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.430195:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.430197:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f102800/0xefc4487a018073e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2035 expref: 3990 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430202:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f102800/0xefc4487a018073e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2035 expref: 3990 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430210:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f102800/0xefc4487a018073e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2035 expref: 3990 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430216:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.430226:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:1857:x1788538641027968:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.430230:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332949 00000100:00100000:0.0:1705683932.430255:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.430270:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.430276:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430277:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430280:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028032 00010000:00010000:0.0:1705683932.430287:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f85400/0xefc4487a01807125 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2019 expref: 3989 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.430311:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430312:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430316:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332951 00000100:00100000:0.0:1705683932.430319:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:1857:x1788538641028032:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.430324:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.430326:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f85400/0xefc4487a01807125 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2019 expref: 3989 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430332:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f85400/0xefc4487a01807125 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2019 expref: 3989 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430344:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f85400/0xefc4487a01807125 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2019 expref: 3989 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430351:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.430353:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.430354:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a639680/0xefc4487a01878a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.430359:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a639680/0xefc4487a01878a3f lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.430370:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.430380:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:1857:x1788538641028032:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.430384:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332951 00000100:00100000:0.0:1705683932.430417:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.430424:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430424:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430427:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028096 00010000:00010000:0.0:1705683932.430434:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8bf980/0xefc4487a0185a0b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ce9 expref: 5949 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.430443:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430444:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430447:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332952 00000100:00100000:0.0:1705683932.430450:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:1857:x1788538641028096:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.430454:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.430457:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8bf980/0xefc4487a0185a0b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ce9 expref: 5949 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430462:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8bf980/0xefc4487a0185a0b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ce9 expref: 5949 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430471:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8bf980/0xefc4487a0185a0b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ce9 expref: 5949 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.430479:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.430480:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.430481:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a639400/0xefc4487a01878a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.430486:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a639400/0xefc4487a01878a4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.430500:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.430509:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5948:1857:x1788538641028096:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 59us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.430532:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332952 00000100:00100000:0.0:1705683932.430697:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.430698:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.430943:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cef80/0xefc4487a01878b0a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.430949:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cef80/0xefc4487a01878b0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.430952:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cef80/0xefc4487a01878b0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000004:00010000:3.0:1705683932.430961:0:6533:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880097efb700 reply state ffff880090774000 transno 4295084963 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cef80/0xefc4487a01878b0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.430966:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cef80/0xefc4487a01878b0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x425a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.430970:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425a:0x0].0x0 (ffff8800818b7000) 00010000:00010000:3.0:1705683932.430972:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1705683932.430989:0:6533:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00010000:00010000:3.0:1705683932.430994:0:6533:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.430998:0:6533:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431001:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431004:0:6533:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.431005:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431006:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.431007:0:6533:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880094d5e080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.431009:0:6533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.431010:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584511232 00010000:00010000:3.0:1705683932.431012:0:6533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431017:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.431019:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.431020:0:6533:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.431021:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431021:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431024:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920809 00000100:00100000:0.0:1705683932.431027:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c93700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3290:3081:x1788538584511232:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.431037:0:6533:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.431040:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.431056:0:6533:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00002000:00010000:0.0:1705683932.431094:0:15116:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95f0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.431096:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95f0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.431097:0:15116:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95f0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.431098:0:15116:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95f0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.431100:0:15116:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95f0:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1705683932.431118:0:6533:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431123:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5e080/0xefc4487a01878a46 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT1 00000004:00010000:3.0:1705683932.431142:0:6533:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880097efb700 reply state ffff880090774000 transno 4295084963 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cde00/0xefc4487a01878aee lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431147:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cde00/0xefc4487a01878aee lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.431149:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800818b7700) 00010000:00010000:3.0:1705683932.431150:0:6533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1705683932.431174:0:6533:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efb700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1887:7327:x1788538641026496:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 4726us (4777us total) trans 4295084963 rc 0/0 00000100:00100000:3.0:1705683932.431178:0:6533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413408 00010000:00010000:3.0:1705683932.431195:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.431224:0:6532:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509312:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.431244:0:6532:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509376:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.431249:0:6532:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1788538584509440:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.431270:0:6532:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00010000:00100000:3.0:1705683932.431274:0:6532:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.431274:0:6532:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.431275:0:6532:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.431393:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584509696:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.431412:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cad0280/0xefc4487a01878a9a lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30112c expref: 3987 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.431420:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cad0280, rc 0) 00000100:00100000:0.0:1705683932.431439:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c93700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3291:3081:x1788538584511232:12345-0@lo:2:osp-syn-1-1.0 Request processed in 410us (504us total) trans 4295348291 rc 0/0 00000100:00100000:0.0:1705683932.431446:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920809 00000100:00100000:3.0:1705683932.431449:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3987:4708:x1788538641026880:12345-192.168.203.41@tcp:101:dd.0 Request processed in 3622us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.431453:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920795 00000100:00100000:0.0:1705683932.431503:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431504:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431508:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584511296 00000100:00100000:0.0:1705683932.431519:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431520:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431523:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920810 00000100:00100000:0.0:1705683932.431525:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c95000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3291:3081:x1788538584511296:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.431534:0:15116:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34540 count 1 00010000:00010000:0.0:1705683932.431609:0:15116:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.431618:0:15116:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3986 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.431623:0:15116:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1291b80/0xefc4487a0185a134 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d59 expref: 5946 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.431628:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.431629:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.431630:0:15116:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.431642:0:15116:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1291b80/0xefc4487a0185a134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d59 expref: 5946 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.431648:0:15116:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1291b80/0xefc4487a0185a134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d59 expref: 5946 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.431655:0:15116:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584511360:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.431680:0:15116:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3986 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.431686:0:15116:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3986 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.431697:0:15116:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf1900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584511424:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.431737:0:15116:0:(client.c:2536:ptlrpc_set_wait()) set ffff880134ede0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.431758:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.431847:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.431877:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.431889:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431890:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431894:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028544 00000100:00100000:3.0:1705683932.431901:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.431902:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf1680/0xefc4487a01807164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2051 expref: 3987 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.431912:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431913:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431915:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028480 00000100:00100000:3.0:1705683932.431916:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.431919:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800959abc00/0xefc4487a01847a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc8c expref: 5947 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.431927:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431928:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.431930:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028160 00010000:00010000:0.0:1705683932.431995:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1887 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.432009:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.432009:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.432012:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332957 00000100:00100000:3.0:1705683932.432012:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.432015:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1887:1857:x1788538641028160:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.432020:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.432023:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1887 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.432032:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1887 pid: 6532 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.432053:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.432144:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.432154:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.432155:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.432158:0:6533:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641028672 00010000:00010000:0.0:1705683932.432160:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009853f480/0xefc4487a018714b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41b7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff0be expref: 1887 pid: 6532 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.432168:0:6519:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41b7:0x0].0x0 (ffff88009cff8800) 00010000:00010000:0.0:1705683932.432170:0:6519:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00010000:00010000:0.0:1705683932.432174:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 00010000:00010000:0.0:1705683932.432178:0:6519:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 00000100:00100000:3.0:1705683932.432186:0:6533:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.432187:0:6533:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.432188:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.432190:0:6533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413415 00000100:00100000:3.0:1705683932.432193:0:6533:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133635a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1804:7265:x1788538641028672:12345-192.168.203.41@tcp:36:rm.0 00000100:00100000:0.0:1705683932.432201:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:1857:x1788538641028160:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 186us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.432206:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332957 00010000:00010000:3.0:1705683932.432209:0:6533:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1705683932.432216:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb7ef80/0xefc4487a0187809f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x437e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300e23 expref: 1804 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.432274:0:6533:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009597c780/0xefc4487a01871fa2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x437e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff36c expref: 1803 pid: 6531 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.432295:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5b27300/2, rc 0, transno 380996 00000100:00100000:0.0:1705683932.432301:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b27300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584509632:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.432325:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584511616:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.432333:0:6533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x437e:0x0].0x0 (ffff8801330f0c00) 00010000:00010000:3.0:1705683932.432341:0:6533:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.432359:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15ccc80/0xefc4487a01878b18 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.432366:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15ccc80/0xefc4487a01878b18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.432371:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15ccc80/0xefc4487a01878b18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000100:00100000:0.0:1705683932.432419:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1705683932.432428:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd900/0xefc4487a01878b1f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42b2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.432454:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd900/0xefc4487a01878b1f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.432458:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd900/0xefc4487a01878b1f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.432622:0:6533:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cc780/0xefc4487a01878b26 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x437e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 00010000:00010000:3.0:1705683932.432628:0:6533:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cc780/0xefc4487a01878b26 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x437e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 00010000:00010000:3.0:1705683932.432632:0:6533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cc780/0xefc4487a01878b26 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x437e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000004:00080000:0.0:1705683932.432695:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bbf5000/2, rc 0, transno 380997 00000100:00100000:0.0:1705683932.432701:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584511616:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.432740:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf7300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584511680:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.432757:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.432975:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135573700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584510720:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.433010:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584510400:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.433248:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584510464:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.433263:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.433269:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433269:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433270:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433282:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135570500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584510656:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.433294:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a638c80/0xefc4487a01878ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.433299:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433300:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433300:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433349:0:15173:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:15173:1788538584511104:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.433355:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433356:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433423:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433424:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433427:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029184 00010000:00010000:0.0:1705683932.433435:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081b09680/0xefc4487a0185a0e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d21 expref: 5946 pid: 14223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.433450:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433451:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433453:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029312 00010000:00010000:0.0:1705683932.433459:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d00f00/0xefc4487a018071c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20c1 expref: 3986 pid: 15121 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.433469:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433470:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433472:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029120 00010000:00010000:0.0:1705683932.433478:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013311ad00/0xefc4487a0185a0d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d13 expref: 5948 pid: 15097 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.433487:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433487:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433491:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332963 00000100:00100000:0.0:1705683932.433493:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c90500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5948:1857:x1788538641028800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.433498:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.433501:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0xefc4487a0185a0d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d05 expref: 5947 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.433506:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0xefc4487a0185a0d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d05 expref: 5947 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.433517:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0xefc4487a0185a0d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d05 expref: 5946 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.433525:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.433526:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.433527:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433531:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433541:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.433551:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c90500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5945:1857:x1788538641028800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.433555:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332963 00010000:00010000:0.0:1705683932.433630:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1705683932.433633:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a638000/0xefc4487a01878aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433638:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a638000 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.433639:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a638000/0xefc4487a01878aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433643:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a638000/0xefc4487a01878aa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433651:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a638000/0xefc4487a01878aa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433655:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a638000/0xefc4487a01878aa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433667:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.433668:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433672:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a63aa80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.433673:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433677:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433684:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433687:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a63aa80/0xefc4487a01878aaf lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433696:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.433696:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.433697:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.433727:0:15173:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:15173:1788538584511168:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.433738:0:15173:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.433742:0:15173:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433743:0:15173:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.433743:0:15173:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:0.0:1705683932.433748:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a638c80/0xefc4487a01878ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433753:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a638c80/0xefc4487a01878ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433757:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a638c80/0xefc4487a01878ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433762:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a638c80/0xefc4487a01878ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.433770:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.433855:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3295:3083:x1788538584510528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4027us (4093us total) trans 4295348296 rc 0/0 00000100:00100000:0.0:1705683932.433860:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920804 00000004:00080000:0.0:1705683932.433879:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135575f00/2, rc 0, transno 381000 00000100:00100000:0.0:1705683932.433885:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135575f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584510528:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.433906:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1705683932.433910:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584512064:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.433925:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.433936:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433936:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433939:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584512064 00000100:00100000:0.0:1705683932.433947:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433948:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.433950:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920817 00000100:00100000:0.0:1705683932.433953:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3296:3084:x1788538584512064:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.434001:0:15192:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95f3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.434003:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95f3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.434004:0:15192:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95f3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.434006:0:15192:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95f3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.434007:0:15192:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95f3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.434024:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3297:3084:x1788538584512064:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (98us total) trans 4295348297 rc 0/0 00000100:00100000:0.0:1705683932.434031:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920817 00000004:00080000:0.0:1705683932.434048:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bbf6400/2, rc 0, transno 381001 00000100:00100000:0.0:1705683932.434052:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584512064:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.434089:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf3700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584512128:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.434105:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.434120:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434121:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434124:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584512128 00000100:00100000:0.0:1705683932.434138:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434139:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434142:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920818 00000100:00100000:0.0:1705683932.434145:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3297:3084:x1788538584512128:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.434153:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34543 count 1 00080000:00000400:2.0:1705683932.434307:0:14255:0:(osd_handler.c:2003:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1705683932.434332:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434332:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434336:0:6520:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029248 00010000:00010000:0.0:1705683932.434345:0:6520:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3984 pid: 15121 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.434354:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434354:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434356:0:6520:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029440 00010000:00010000:0.0:1705683932.434359:0:6520:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e105400/0xefc4487a0185a103 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d44 expref: 5945 pid: 15099 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.434373:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434373:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434375:0:6520:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029376 00010000:00010000:0.0:1705683932.434380:0:6520:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880086177200/0xefc4487a0185a0f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d2f expref: 5946 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.434387:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434388:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434391:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332967 00000100:00100000:0.0:1705683932.434393:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3985:1857:x1788538641029248:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.434398:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.434400:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3985 pid: 15121 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434406:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3985 pid: 15121 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434417:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb8f200/0xefc4487a01807187 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2089 expref: 3985 pid: 15121 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434424:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434425:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434426:0:6520:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434430:0:6520:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434440:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.434449:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:1857:x1788538641029248:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.434453:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332967 00000100:00100000:0.0:1705683932.434459:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434460:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434462:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332970 00000100:00100000:0.0:1705683932.434464:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:1857:x1788538641029504:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.434468:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.434470:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098748f00/0xefc4487a018071d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20d6 expref: 3983 pid: 15162 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434476:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098748f00/0xefc4487a018071d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20d6 expref: 3983 pid: 15162 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434485:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098748f00/0xefc4487a018071d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20d6 expref: 3983 pid: 15162 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.434490:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434491:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434492:0:6520:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434496:0:6520:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434506:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.434514:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:1857:x1788538641029504:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 49us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.434519:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332970 00010000:00010000:0.0:1705683932.434535:0:15173:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434545:0:15173:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434549:0:15173:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434553:0:15173:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a639e00/0xefc4487a01878b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434560:0:15173:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1705683932.434633:0:15173:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c92800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+3298:3084:x1788538584511040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3934us (4033us total) trans 4295348299 rc 0/0 00000100:00100000:0.0:1705683932.434638:0:15173:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920808 00010000:00010000:0.0:1705683932.434649:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1705683932.434659:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099c91900/2, rc 0, transno 381003 00000100:00100000:0.0:1705683932.434662:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c91900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584511040:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.434670:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434675:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434680:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434683:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800875c7200/0xefc4487a01878abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434692:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.434773:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fba800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3300:3081:x1788538584510144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5440us (5620us total) trans 4295348300 rc 0/0 00000100:00100000:0.0:1705683932.434778:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920800 00000100:00100000:0.0:1705683932.434786:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434786:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.434789:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920821 00000100:00100000:0.0:1705683932.434792:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3300:3081:x1788538584512448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.434800:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34544 count 1 00010000:00010000:0.0:1705683932.434899:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434906:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3981 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.434911:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.434914:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434915:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.434916:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434928:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.434934:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.434942:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584512640:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.434959:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3981 pid: 15140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.434965:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3981 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.434971:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584512704:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.434979:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181af00 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.434990:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.434996:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9e00/0xefc4487a01807260 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2154 expref: 3981 pid: 15109 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.435000:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801322faf80/0xefc4487a0185a18f lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d8a expref: 5942 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.435004:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.435004:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.435005:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435014:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801322faf80/0xefc4487a0185a18f lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d8a expref: 5942 pid: 15122 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.435023:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801322faf80/0xefc4487a0185a18f lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d8a expref: 5942 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.435028:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584512768:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.435040:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9e00/0xefc4487a01807260 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2154 expref: 3981 pid: 15109 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.435046:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9e00/0xefc4487a01807260 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2154 expref: 3981 pid: 15109 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.435051:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584512832:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.435059:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.435066:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435067:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435071:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029568 00010000:00010000:3.0:1705683932.435105:0:6532:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00000100:00100000:0.0:1705683932.435114:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435115:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435120:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413416 00000100:00100000:0.0:1705683932.435123:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fb9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1922:7185:x1788538641029568:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:3.0:1705683932.435123:0:6532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00010000:00010000:0.0:1705683932.435130:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.435141:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801333da080/0xefc4487a01878b5e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301156 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1705683932.435152:0:6532:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41b7:0x0]: returning size 0 00010000:00010000:0.0:1705683932.435182:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801333d9900/0xefc4487a01878b6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.435192:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801333d9900/0xefc4487a01878b6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.435197:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801333d9900/0xefc4487a01878b6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 00000004:00200000:0.0:1705683932.435215:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000404:0x40bb:0x0]: returning size 4096 00000004:00200000:0.0:1705683932.435217:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1705683932.435243:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801333da080/0xefc4487a01878b5e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301156 expref: 1924 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435252:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801333d9900/0xefc4487a01878b6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301156 expref: 1923 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435257:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:0.0:1705683932.435259:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1705683932.435260:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801333d9900, rc 0) 00000100:00100000:0.0:1705683932.435272:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fb9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1923:7185:x1788538641029568:12345-192.168.203.41@tcp:101:rm.0 Request processed in 148us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.435277:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413416 00000100:00100000:0.0:1705683932.435400:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435401:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435405:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641029632 00000100:00100000:0.0:1705683932.435418:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435419:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435422:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 73798 00000100:00100000:0.0:1705683932.435426:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1803:1854:x1788538641029632:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.435431:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.435439:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d9180/0xefc4487a01878ae0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301148 expref: 1803 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.435440:0:6532:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880094d5ed00/0xefc4487a01878a5b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301117 expref: 1887 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435447:0:6519:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff880135984700) 00010000:00010000:0.0:1705683932.435449:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.435474:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1802:1854:x1788538641029632:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 48us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.435479:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 73798 00010000:00010000:3.0:1705683932.435489:0:6532:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cad0f00/0xefc4487a01878a70 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x41b7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301117 expref: 1886 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.435499:0:15116:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584511360:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.435505:0:15116:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf1900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584511424:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.435505:0:6532:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41b7:0x0].0x0 (ffff88009cff8800) 00010000:00010000:3.0:1705683932.435507:0:6532:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1705683932.435508:0:6532:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cad0f00, rc 0) 00010000:00010000:0.0:1705683932.435518:0:15116:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.435522:0:15116:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.435523:0:15116:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.435524:0:15116:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.435531:0:6532:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d8a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7338:x1788538641026624:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 8826us (9001us total) trans 4295084964 rc 0/0 00000100:00100000:3.0:1705683932.435536:0:6532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413410 00010000:00010000:3.0:1705683932.435575:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1705683932.435682:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.435739:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435740:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435746:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332972 00000100:00100000:0.0:1705683932.435750:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:1856:x1788538641029888:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.435756:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.435758:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3981 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.435765:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3981 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.435776:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb81900/0xefc4487a018071f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d20f2 expref: 3981 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.435786:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.435787:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.435788:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435793:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435805:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.435825:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1856:x1788538641029888:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.435829:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332972 00000100:00100000:3.0:1705683932.435835:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.435845:0:15116:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435850:0:15116:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435855:0:15116:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435859:0:15116:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8000/0xefc4487a01878b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.435872:0:15116:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1705683932.435884:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.435908:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435909:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435913:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030016 00010000:00010000:0.0:1705683932.435922:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30111e expref: 1886 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.435931:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435932:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.435935:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332973 00000100:00100000:0.0:1705683932.435938:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:1856:x1788538641030016:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.435942:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.435945:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30111e expref: 1886 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.435950:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30111e expref: 1886 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.435958:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a63b980/0xefc4487a01878a69 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30111e expref: 1886 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.435966:0:6519:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.435968:0:6519:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.435972:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.435976:0:6519:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.435986:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.435995:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1885:1856:x1788538641030016:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.436001:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332973 00010000:00010000:0.0:1705683932.436015:0:14222:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.436018:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8a00/0xefc4487a01878af5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:3.0:1705683932.436021:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.436030:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436030:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436034:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030080 00000100:00100000:3.0:1705683932.436043:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436043:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436046:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920828 00010000:00010000:0.0:1705683932.436104:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8780/0xefc4487a01878b88 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:0.0:1705683932.436110:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8780/0xefc4487a01878b88 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:3.0:1705683932.436111:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3534:4708:x1788538641030080:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.436114:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801333d8780/0xefc4487a01878b88 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.436131:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.436180:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d3700/0xefc4487a01878b8f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:0.0:1705683932.436185:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d3700/0xefc4487a01878b8f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.436190:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d3700/0xefc4487a01878b8f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:3.0:1705683932.436223:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436224:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436227:0:6532:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030208 00010000:00010000:0.0:1705683932.436234:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0780/0xefc4487a01878b96 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:3.0:1705683932.436238:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436239:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.436240:0:14222:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880087734500/0xefc4487a01874f4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300077 expref: 1885 pid: 6531 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.436241:0:6532:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030272 00010000:00010000:0.0:1705683932.436244:0:14222:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0780/0xefc4487a01878b96 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x422f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:3.0:1705683932.436247:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436247:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.436250:0:6532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413417 00000100:00100000:3.0:1705683932.436252:0:6532:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b22800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7334:x1788538641030208:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:0.0:1705683932.436260:0:14222:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880087734500/0xefc4487a01874f4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300077 expref: 1886 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.436265:0:14222:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880087734500/0xefc4487a01874f4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300077 expref: 1886 pid: 6531 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.436271:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:14222:1788538584513344:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.436290:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.436298:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.436299:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.436304:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413418 00000100:00100000:0.0:1705683932.436306:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7345:x1788538641030272:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:0.0:1705683932.436312:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.436316:0:6532:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b22800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7334:x1788538641030208:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 63us (225us total) trans 0 rc -17/-17 00000100:00100000:3.0:1705683932.436320:0:6532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413417 00010000:00010000:3.0:1705683932.436335:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a15cd180/0xefc4487a01878b9d lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301172 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.436362:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c9ed00/0xefc4487a01847a15 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc93 expref: 3456 pid: 15219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.436366:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.436367:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2a80/0xefc4487a01878ba4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301179 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.436367:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.436368:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a15cd180/0xefc4487a01878b9d lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301172 expref: 3535 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.436379:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c9ed00/0xefc4487a01847a15 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc93 expref: 3456 pid: 15219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.436425:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c9ed00/0xefc4487a01847a15 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc93 expref: 3456 pid: 15219 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.436428:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.436434:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436439:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.436443:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0000_UUID:15223:1788538584513408:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.436444:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.436448:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436455:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.436469:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.436478:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0000/0xefc4487a01878bb9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x425a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.436541:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0000/0xefc4487a01878bb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436548:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0000/0xefc4487a01878bb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:0.0:1705683932.436562:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00000004:00200000:0.0:1705683932.436564:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1705683932.436571:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0000/0xefc4487a01878bb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436576:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436579:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436582:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436585:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436588:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d2f80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.436589:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436592:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436597:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.436598:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.436599:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436603:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2f80/0xefc4487a01878bab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436610:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436613:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436616:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436619:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d1e00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.436621:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436624:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436629:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800818b7700) 00010000:00010000:0.0:1705683932.436630:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.436632:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436635:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d1e00/0xefc4487a01878bb2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.436738:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2a80/0xefc4487a01878ba4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301179 expref: 1887 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.436746:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0000/0xefc4487a01878bb9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x425a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301179 expref: 1886 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.436749:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425a:0x0].0x0 (ffff8800818b7000) 00010000:00010000:0.0:1705683932.436750:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1705683932.436751:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a3d0000, rc 0) 00000100:00100000:0.0:1705683932.436775:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1886:7345:x1788538641030272:12345-192.168.203.41@tcp:101:touch.0 Request processed in 466us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.436779:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413418 00000100:00100000:0.0:1705683932.436986:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c95000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3304:3081:x1788538584511296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5459us (5492us total) trans 4295348304 rc 0/0 00000100:00100000:0.0:1705683932.436991:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920810 00000100:00100000:0.0:1705683932.437026:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437027:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437030:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584513472 00000100:00100000:0.0:1705683932.437040:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437040:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437044:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920829 00000100:00100000:0.0:1705683932.437046:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b24600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3304:3084:x1788538584513472:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.437114:0:15116:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95f7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.437116:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95f7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.437117:0:15116:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95f7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.437118:0:15116:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95f7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.437119:0:15116:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95f7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.437140:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b24600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3305:3084:x1788538584513472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 92us (123us total) trans 4295348305 rc 0/0 00000100:00100000:0.0:1705683932.437144:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920829 00000100:00100000:0.0:1705683932.437187:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437188:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437191:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584513536 00000100:00100000:0.0:1705683932.437199:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437200:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.437202:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437203:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920830 00000100:00100000:3.0:1705683932.437203:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.437206:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880132350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3305:3083:x1788538584513536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.437215:0:15116:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34547 count 1 00010000:00010000:0.0:1705683932.437305:0:15116:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.437313:0:15116:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332a2800/0xefc4487a018072d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21cb expref: 3979 pid: 15174 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.437317:0:15116:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801321b7980/0xefc4487a0185a1ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dd7 expref: 5941 pid: 15219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.437322:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.437323:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.437323:0:15116:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.437336:0:15116:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801321b7980/0xefc4487a0185a1ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dd7 expref: 5941 pid: 15219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.437341:0:15116:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801321b7980/0xefc4487a0185a1ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dd7 expref: 5941 pid: 15219 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.437347:0:15116:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098451400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584513600:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.437368:0:15116:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801332a2800/0xefc4487a018072d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21cb expref: 3979 pid: 15174 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.437373:0:15116:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801332a2800/0xefc4487a018072d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21cb expref: 3979 pid: 15174 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.437378:0:15116:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098457300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584513664:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.437387:0:15116:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.438101:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.438129:0:15128:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.438130:0:15128:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.438155:0:15128:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641020928 00002000:00010000:3.0:1705683932.438177:0:15128:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161090/37112 (0->18446744073709551615) 00080000:00040000:2.0:1705683932.438182:0:14255:0:(osd_internal.h:1417:osd_trans_exec_check()) LBUG 00002000:00100000:3.0:1705683932.438187:0:15128:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e281e00 with x1788538641020928 ext(0->18446744073709551615) 00002000:00010000:3.0:1705683932.438226:0:15128:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e281e00. 00000100:00100000:3.0:1705683932.438237:0:15128:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.438238:0:15128:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.438242:0:15128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150735 00000100:00100000:3.0:1705683932.438245:0:15128:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5942:1857:x1788538641020928:12345-192.168.203.41@tcp:10:dir_create.sh.0 00000100:00100000:0.0:1705683932.438321:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00002000:00010000:3.0:1705683932.438394:0:15128:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x90f8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.438396:0:15128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x90f8:0x0] updating lvb mtime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.438398:0:15128:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x90f8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.438399:0:15128:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x90f8:0x0] updating lvb ctime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.438400:0:15128:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x90f8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.438420:0:15128:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:1857:x1788538641020928:12345-192.168.203.41@tcp:10:dir_create.sh.0 Request processed in 173us (24529us total) trans 4295348306 rc 0/0 00000100:00100000:3.0:1705683932.438425:0:15128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150735 00002000:00010000:3.0:1705683932.438427:0:15128:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161090/37112 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.438429:0:15128:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e281e00 with x1788538641020928 ext(0->18446744073709551615) 00000100:00100000:0.0:1705683932.438463:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098450000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584512832:192.168.203.41@tcp:104: 00002000:00010000:3.0:1705683932.438464:0:15128:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e281e00. 00000100:00100000:0.0:1705683932.438510:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584512640:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.438556:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584512704:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.438570:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.438575:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438576:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438577:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438601:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098450500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:14222:1788538584513344:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.438609:0:14222:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0780/0xefc4487a01878b96 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x422f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00100000:0.0:1705683932.438612:0:14222:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438613:0:14222:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438613:0:14222:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438645:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584512768:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.438655:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.438660:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438660:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.438661:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438686:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.438698:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.438719:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.438734:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.438741:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438742:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438746:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030592 00010000:00010000:0.0:1705683932.438756:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf3980/0xefc4487a0180720c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d210e expref: 3982 pid: 15109 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.438766:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438767:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438769:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030720 00010000:00010000:0.0:1705683932.438774:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ecad00/0xefc4487a0180723d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2131 expref: 3983 pid: 15121 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.438782:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438783:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438786:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332974 00000100:00100000:0.0:1705683932.438789:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:1856:x1788538641030592:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.438795:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.438797:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf3980/0xefc4487a0180720c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d210e expref: 3983 pid: 15109 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.438808:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf3980/0xefc4487a0180720c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d210e expref: 3983 pid: 15109 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.438818:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf3980/0xefc4487a0180720c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d210e expref: 3983 pid: 15109 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.438827:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.438840:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1856:x1788538641030592:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.438845:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332974 00000100:00100000:0.0:1705683932.438862:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438863:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438881:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.438887:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438888:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438891:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030848 00010000:00010000:0.0:1705683932.438899:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b37c00/0xefc4487a0181e4a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d981c expref: 3980 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.438989:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438990:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.438993:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332976 00000100:00100000:0.0:1705683932.438996:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098455a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1856:x1788538641030848:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.439002:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.439005:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b37c00/0xefc4487a0181e4a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d981c expref: 3980 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439014:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b37c00/0xefc4487a0181e4a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d981c expref: 3980 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439026:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b37c00/0xefc4487a0181e4a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d981c expref: 3980 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439035:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439036:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439038:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a63af80/0xefc4487a01878b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30115d expref: 5941 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439043:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a63af80/0xefc4487a01878b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30115d expref: 5941 pid: 15191 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439056:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a63af80/0xefc4487a01878b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30115d expref: 5941 pid: 15191 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.439063:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098456400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584513792:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.439095:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.439119:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439126:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439127:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439144:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641030976 00010000:00010000:0.0:1705683932.439154:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.439168:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332977 00000100:00100000:0.0:1705683932.439171:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098454600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5942:1856:x1788538641030976:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.439176:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.439178:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439184:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439192:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6129b80/0xefc4487a0185a1ab lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d98 expref: 5942 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439200:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.439210:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098454600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5941:1856:x1788538641030976:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 38us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.439214:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332977 00000100:00100000:0.0:1705683932.439241:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439248:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439249:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439266:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641031104 00010000:00010000:0.0:1705683932.439273:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c29b80/0xefc4487a0185a1e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dc9 expref: 5941 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.439284:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439284:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439288:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332978 00000100:00100000:0.0:1705683932.439291:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5941:1856:x1788538641031104:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.439296:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.439298:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c29b80/0xefc4487a0185a1e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dc9 expref: 5941 pid: 15116 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439304:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c29b80/0xefc4487a0185a1e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dc9 expref: 5941 pid: 15116 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439312:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c29b80/0xefc4487a0185a1e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dc9 expref: 5941 pid: 15116 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439321:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.439331:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:1856:x1788538641031104:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 39us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.439335:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332978 00000100:00100000:0.0:1705683932.439370:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439377:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439378:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439382:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641031232 00010000:00010000:0.0:1705683932.439388:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3980 pid: 15140 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.439398:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439398:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439401:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332979 00000100:00100000:0.0:1705683932.439404:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098454100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1856:x1788538641031232:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.439409:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.439411:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3980 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439417:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3980 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439427:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbef80/0xefc4487a01807252 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2170 expref: 3980 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.439435:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439436:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439437:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439442:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439453:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.439478:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098454100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:1856:x1788538641031232:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.439482:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332979 00010000:00010000:0.0:1705683932.439495:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439500:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439505:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439510:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439517:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.439603:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3306:3081:x1788538584512448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4809us (4902us total) trans 4295348307 rc 0/0 00000100:00100000:0.0:1705683932.439607:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920821 00010000:00010000:0.0:1705683932.439629:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.439632:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439638:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801333d8c80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.439639:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439656:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439664:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439668:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801333d8c80/0xefc4487a01878b49 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439677:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.439678:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.439679:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.439696:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439703:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439704:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439719:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641031360 00010000:00010000:0.0:1705683932.439728:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf9c780/0xefc4487a017f4b09 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca220 expref: 3536 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.439738:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439739:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439742:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332980 00000100:00100000:0.0:1705683932.439744:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:1856:x1788538641031360:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.439749:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.439751:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf9c780/0xefc4487a017f4b09 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca220 expref: 3536 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439756:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf9c780/0xefc4487a017f4b09 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca220 expref: 3536 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439767:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9c780/0xefc4487a017f4b09 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca220 expref: 3536 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.439775:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439776:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.439779:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a624500/0xefc4487a01878b81 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30116b expref: 3456 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439784:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a624500/0xefc4487a01878b81 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30116b expref: 3456 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.439802:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a624500/0xefc4487a01878b81 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30116b expref: 3457 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.439809:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098453700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584513920:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.439822:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.439832:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439833:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439836:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584513856 00000100:00100000:0.0:1705683932.439847:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439848:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.439851:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920834 00000100:00100000:0.0:1705683932.439854:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3306:3081:x1788538584513856:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.439901:0:15133:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95f8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.439903:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95f8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.439904:0:15133:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95f8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.439905:0:15133:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95f8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.439906:0:15133:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95f8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.439926:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3307:3081:x1788538584513856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 72us (162us total) trans 4295348308 rc 0/0 00000100:00100000:0.0:1705683932.439931:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920834 00000100:00100000:0.0:1705683932.439955:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439968:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439982:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.439999:0:6520:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440000:0:6520:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440005:0:6520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332983 00000100:00100000:0.0:1705683932.440008:0:6520:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:1856:x1788538641030656:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.440014:0:6520:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.440017:0:6520:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801322fb700/0xefc4487a0185a17a lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d7c expref: 5940 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.440023:0:6520:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801322fb700/0xefc4487a0185a17a lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d7c expref: 5940 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.440034:0:6520:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801322fb700/0xefc4487a0185a17a lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8d7c expref: 5940 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.440040:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440041:0:6520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440042:0:6520:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440047:0:6520:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440058:0:6520:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.440067:0:6520:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5938:1856:x1788538641030656:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.440071:0:6520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332983 00010000:00010000:0.0:1705683932.440097:0:15220:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440102:0:15220:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440110:0:15220:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440114:0:15220:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a63b200/0xefc4487a01878b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15220 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.440123:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440124:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440127:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584514048 00000100:00100000:0.0:1705683932.440135:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440136:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440139:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920835 00000100:00100000:0.0:1705683932.440141:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3307:3081:x1788538584514048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.440149:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34548 count 1 00010000:00010000:0.0:1705683932.440283:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440291:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be5c280/0xefc4487a018072d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21ee expref: 3977 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440297:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6128780/0xefc4487a0185a1f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8de5 expref: 5936 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440301:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440302:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440303:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440319:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6128780/0xefc4487a0185a1f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8de5 expref: 5936 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440325:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6128780/0xefc4487a0185a1f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8de5 expref: 5936 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.440333:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584514176:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.440350:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be5c280/0xefc4487a018072d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21ee expref: 3977 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440356:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be5c280/0xefc4487a018072d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21ee expref: 3977 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.440362:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584514240:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.440371:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.440382:0:15220:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.440473:0:15220:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_107:lustre-MDT0001-mdtlov_UUID+3310:3081:x1788538584512000:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6568us (6586us total) trans 4295348311 rc 0/0 00000100:00100000:0.0:1705683932.440478:0:15220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920816 00002000:00080000:0.0:1705683932.440496:0:15148:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34549 count 1 00010000:00010000:0.0:1705683932.440624:0:15148:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440632:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f62080/0xefc4487a01807301 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d220a expref: 3977 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440640:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135598000/0xefc4487a0185a206 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8df3 expref: 5936 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440645:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440645:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.440646:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440658:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135598000/0xefc4487a0185a206 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8df3 expref: 5936 pid: 14248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440663:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135598000/0xefc4487a0185a206 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8df3 expref: 5936 pid: 14248 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.440669:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584514496:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.440687:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f62080/0xefc4487a01807301 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d220a expref: 3977 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.440693:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f62080/0xefc4487a01807301 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d220a expref: 3977 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.440698:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584514560:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.440718:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181af00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.440738:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.440758:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.440770:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.440784:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.440792:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440793:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440797:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641031808 00000100:00100000:0.0:1705683932.440814:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440814:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.440818:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107555 00000100:00100000:0.0:1705683932.440822:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1923:7185:x1788538641031808:12345-192.168.203.41@tcp:35:rm.0 00000100:00100000:0.0:1705683932.440897:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1924:7185:x1788538641031808:12345-192.168.203.41@tcp:35:rm.0 Request processed in 74us (112us total) trans 4295091441 rc 0/0 00000100:00100000:0.0:1705683932.440902:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107555 00010000:00010000:0.0:1705683932.440920:0:14222:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0780/0xefc4487a01878b96 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x422f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.440925:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d0780/0xefc4487a01878b96 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x422f:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.440934:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2800/0xefc4487a01878c1b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x421b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:0.0:1705683932.440940:0:14222:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1887 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440944:0:14222:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2800/0xefc4487a01878c1b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x421b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.440957:0:14222:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1887 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.440962:0:14222:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1887 pid: 6531 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.440967:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216e00 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:14222:1788538584514688:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.441048:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.441068:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.441094:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.441117:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.441128:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.441140:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.441145:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441145:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441151:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641032064 00000100:00100000:0.0:1705683932.441161:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441161:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441165:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107556 00000100:00100000:0.0:1705683932.441168:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e191050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1888:7342:x1788538641032064:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:0.0:1705683932.441243:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e191050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1889:7342:x1788538641032064:12345-192.168.203.41@tcp:35:touch.0 Request processed in 73us (101us total) trans 4295084966 rc 0/0 00000100:00100000:0.0:1705683932.441247:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107556 00010000:00010000:0.0:1705683932.441293:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441298:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441303:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441311:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441318:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.441392:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3313:3084:x1788538584512128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7245us (7286us total) trans 4295348314 rc 0/0 00000100:00100000:0.0:1705683932.441396:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920818 00010000:00010000:0.0:1705683932.441407:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.441409:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441413:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801333daa80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.441415:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441419:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441427:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441431:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801333daa80/0xefc4487a01878b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.441442:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.441443:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.441444:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1705683932.441458:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a1fbf300/2, rc 0, transno 381019 00000100:00100000:0.0:1705683932.441463:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fbf300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584514752:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1705683932.441470:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bbf3700/2, rc 0, transno 381018 00000100:00100000:0.0:1705683932.441472:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf3700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584512128:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.441501:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133211900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584514816:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.441517:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1705683932.441594:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801315da300/2, rc 0, transno 381020 00000100:00100000:0.0:1705683932.441600:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584512576:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.441621:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584514880:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.441636:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1705683932.441643:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.441646:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1705683932.441647:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441648:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441649:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584514944:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.441652:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584514880 00000100:00100000:0.0:1705683932.441661:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.441664:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441665:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441666:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584514944 00000100:00100000:0.0:1705683932.441673:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441673:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.441674:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441674:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.441677:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920842 00000100:00100000:3.0:1705683932.441679:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3315:3081:x1788538584514880:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.441759:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920843 00002000:00010000:3.0:1705683932.441762:0:15215:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95fc:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1705683932.441764:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3316:3081:x1788538584514944:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1705683932.441764:0:15215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95fc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.441765:0:15215:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95fc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.441766:0:15215:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95fc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.441767:0:15215:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95fc:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00080000:0.0:1705683932.441773:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34552 count 1 00000100:00100000:3.0:1705683932.441791:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3316:3081:x1788538584514880:12345-0@lo:2:osp-syn-1-1.0 Request processed in 111us (154us total) trans 4295348317 rc 0/0 00000100:00100000:3.0:1705683932.441813:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920842 00010000:00010000:0.0:1705683932.441849:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.441850:0:15223:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c9ed00/0xefc4487a01847a15 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc93 expref: 3457 pid: 15219 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.441857:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073c76800/0xefc4487a0180738d lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2257 expref: 3975 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.441862:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bfca00/0xefc4487a0185a237 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e2b expref: 5935 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.441867:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.441868:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.441869:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.441879:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0000_UUID:15223:1788538584513408:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.441895:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a15cd180/0xefc4487a01878b9d lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301172 expref: 3535 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.441901:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15cd180, rc 0) 00000100:00100000:3.0:1705683932.441913:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3535:4708:x1788538641030080:12345-192.168.203.41@tcp:101:dd.0 Request processed in 5863us (5892us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.441917:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920828 00010000:00010000:0.0:1705683932.441929:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bfca00/0xefc4487a0185a237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e2b expref: 5935 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.441935:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bfca00/0xefc4487a0185a237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e2b expref: 5935 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.441943:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584515200:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.441961:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073c76800/0xefc4487a0180738d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2257 expref: 3975 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.441966:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073c76800/0xefc4487a0180738d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2257 expref: 3975 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.441971:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584515264:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.441980:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182480 going to sleep for 11 seconds 00000004:00080000:0.0:1705683932.441995:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880133212d00/2, rc 0, transno 381021 00000100:00100000:0.0:1705683932.442000:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584514880:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.442003:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.442004:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.442008:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641032384 00000100:00100000:0.0:1705683932.442019:0:3084:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1705683932.442019:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.442019:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442023:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584515328:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.442038:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920844 00000100:00100000:0.0:1705683932.442039:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.442041:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:7259:x1788538641032384:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.442046:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.442055:0:14236:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442055:0:14236:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.442071:0:15116:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801321b7980/0xefc4487a0185a1ea lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8dd7 expref: 5935 pid: 15219 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.442091:0:15116:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098451400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584513600:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.442178:0:15116:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332a2800/0xefc4487a018072d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d21cb expref: 3975 pid: 15174 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.442186:0:15116:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098457300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0001_UUID:15116:1788538584513664:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.442200:0:15116:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.442204:0:15116:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.442204:0:15116:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.442205:0:15116:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:0.0:1705683932.442215:0:15116:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.442219:0:15116:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.442223:0:15116:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.442227:0:15116:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0a00/0xefc4487a01878bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.442237:0:15116:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.442366:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880132350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3318:3083:x1788538584513536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5158us (5189us total) trans 4295348319 rc 0/0 00000100:00100000:0.0:1705683932.442370:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920830 00010000:00010000:3.0:1705683932.442426:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a15cea80/0xefc4487a01878c45 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9641:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011a3 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.442441:0:15223:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9641:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.442449:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.442450:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.442453:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a15cea80/0xefc4487a01878c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 131072->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011a3 expref: 3975 pid: 15223 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.442460:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5b24100/2, rc 0, transno 381023 00000100:00100000:0.0:1705683932.442465:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b24100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584513536:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.442475:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a15cea80/0xefc4487a01878c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 131072->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011a3 expref: 3975 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.442478:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098456400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584513792:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.442481:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15cea80, rc 0) 00010000:00010000:0.0:1705683932.442486:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.442496:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098455a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:1856:x1788538641030848:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 3499us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.442501:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:7259:x1788538641032384:12345-192.168.203.41@tcp:101:dd.0 Request processed in 459us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.442502:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332976 00000100:00100000:3.0:1705683932.442505:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920844 00000100:00100000:0.0:1705683932.442551:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098453700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584513920:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.442560:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.442568:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3534:1856:x1788538641031360:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2823us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.442572:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332980 00000100:00100000:0.0:1705683932.442603:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.442614:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.442665:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442666:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442669:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641032576 00000100:00100000:0.0:1705683932.442676:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442677:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442680:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107557 00000100:00100000:0.0:1705683932.442683:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133211400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1895:16427:x1788538641032576:12345-192.168.203.41@tcp:35:dir_create.sh.0 00000100:00100000:0.0:1705683932.442770:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133211400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1896:16427:x1788538641032576:12345-192.168.203.41@tcp:35:dir_create.sh.0 Request processed in 86us (156us total) trans 4295084970 rc 0/0 00000100:00100000:0.0:1705683932.442773:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107557 00000100:00100000:0.0:1705683932.442786:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442787:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442790:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641032448 00000100:00100000:0.0:1705683932.442807:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442808:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.442812:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920847 00000100:00100000:0.0:1705683932.442815:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:6496:x1788538641032448:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.442829:0:15116:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.442957:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099c90500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584515584:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.442975:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1705683932.442998:0:15116:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0280/0xefc4487a01878c68 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9209:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011aa expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.443007:0:15116:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9209:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.443015:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.443016:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.443019:0:15116:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0280/0xefc4487a01878c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011aa expref: 3975 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443026:0:15116:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0280/0xefc4487a01878c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011aa expref: 3975 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443032:0:15116:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a3d0280, rc 0) 00000100:00100000:0.0:1705683932.443042:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:6496:x1788538641032448:12345-192.168.203.41@tcp:101:dd.0 Request processed in 227us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.443047:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920847 00000100:00100000:0.0:1705683932.443055:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443056:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443058:0:15116:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584515584 00000100:00100000:0.0:1705683932.443097:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443098:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443102:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920848 00000100:00100000:0.0:1705683932.443104:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3318:3081:x1788538584515584:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.443164:0:15116:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.443166:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95fe:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.443167:0:15116:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95fe:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.443168:0:15116:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95fe:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.443169:0:15116:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95fe:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.443200:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:lustre-MDT0001-mdtlov_UUID+3319:3081:x1788538584515584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (225us total) trans 4295348320 rc 0/0 00000100:00100000:0.0:1705683932.443205:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920848 00000100:00100000:3.0:1705683932.443207:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443208:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443213:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641032960 00000004:00080000:0.0:1705683932.443230:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099c90500/2, rc 0, transno 381024 00000100:00100000:0.0:1705683932.443236:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c90500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584515584:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.443237:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443237:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443240:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641033024 00000100:00100000:0.0:1705683932.443247:0:15116:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443247:0:15116:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443248:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443249:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.443251:0:15116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920849 00000100:00100000:0.0:1705683932.443254:0:15116:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c90a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3456:16415:x1788538641032960:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.443254:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920850 00000100:00100000:3.0:1705683932.443257:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c96900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:6521:x1788538641033024:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.443259:0:15116:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.443260:0:14282:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.443427:0:15116:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a3d3980/0xefc4487a01878c76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011b8 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443440:0:15116:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a6aaa80/0xefc4487a0181e854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d98e0 expref: 3533 pid: 15168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443444:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.443445:0:15116:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.443446:0:15116:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a3d3980/0xefc4487a01878c76 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011b8 expref: 3457 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443467:0:15116:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a6aaa80/0xefc4487a0181e854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d98e0 expref: 3533 pid: 15168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.443472:0:15116:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a6aaa80/0xefc4487a0181e854 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d98e0 expref: 3533 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.443478:0:15116:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133212800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0000_UUID:15116:1788538584515712:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.443491:0:15116:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab540 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.443557:0:14282:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a15ccf00/0xefc4487a01878c84 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x936e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011bf expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.443567:0:14282:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x936e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.443574:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.443575:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.443593:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a15ccf00/0xefc4487a01878c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x936e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011bf expref: 5938 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.443600:0:14282:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a15ccf00/0xefc4487a01878c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x936e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011bf expref: 5938 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.443605:0:14282:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15ccf00, rc 0) 00000100:00100000:0.0:1705683932.443611:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1705683932.443617:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099c94b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584515840:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.443617:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c96900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5938:6521:x1788538641033024:12345-192.168.203.41@tcp:101:dd.0 Request processed in 360us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.443621:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920850 00000100:00100000:0.0:1705683932.443631:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.443648:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443649:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443652:0:14282:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584515840 00000100:00100000:3.0:1705683932.443673:0:14282:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443674:0:14282:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.443687:0:14282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920852 00000100:00100000:3.0:1705683932.443690:0:14282:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3319:3081:x1788538584515840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1705683932.443722:0:14282:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34554 count 1 00010000:00010000:3.0:1705683932.443797:0:14282:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.443815:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3974 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.443821:0:14282:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5937 pid: 15220 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.443824:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.443824:0:14282:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.443825:0:14282:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.443844:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5937 pid: 15220 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.443847:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5937 pid: 15220 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.443851:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584515904:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.443890:0:14282:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3974 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.443905:0:14282:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3974 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.443912:0:14282:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584515968:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.443942:0:14282:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.444325:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584514496:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.444344:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584514560:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.444354:0:15148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.444358:0:15148:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.444359:0:15148:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.444359:0:15148:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444412:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.444534:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444536:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444550:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.444557:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444558:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444561:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641033152 00010000:00010000:0.0:1705683932.444568:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6128780/0xefc4487a0185a1f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8de5 expref: 5938 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.444645:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444646:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444662:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.444667:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444667:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444669:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641033408 00010000:00010000:0.0:1705683932.444675:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1897 pid: 6531 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.444682:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444682:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.444684:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332997 00000100:00100000:0.0:1705683932.444686:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1897:1854:x1788538641033408:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.444691:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.444693:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1897 pid: 6531 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.444699:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1897 pid: 6531 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.444706:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085e5a800/0xefc4487a0187376c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x421b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ff993 expref: 1897 pid: 6531 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.444768:0:6518:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x421b:0x0].0x0 (ffff8801358dbf00) 00010000:00010000:0.0:1705683932.444770:0:6518:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2800/0xefc4487a01878c1b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x421b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.444774:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2800/0xefc4487a01878c1b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x421b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.444776:0:6518:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a3d2800/0xefc4487a01878c1b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x421b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.444784:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.444796:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1896:1854:x1788538641033408:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 109us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.444801:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332997 00010000:00010000:0.0:1705683932.444811:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.444814:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444818:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d2580 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.444819:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444822:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444827:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444832:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2580/0xefc4487a01878c06 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444840:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.444840:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.444841:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.444847:0:15148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444850:0:15148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444853:0:15148:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444855:0:15148:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1900/0xefc4487a01878c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.444861:0:15148:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.445010:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3320:3084:x1788538584514304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4597us (4617us total) trans 4295348322 rc 0/0 00000100:00100000:0.0:1705683932.445013:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920837 00000004:00080000:0.0:1705683932.445033:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097efa800/2, rc 0, transno 381026 00000100:00100000:0.0:1705683932.445037:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efa800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584514304:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.445056:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445057:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445061:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584516032 00000100:00100000:0.0:1705683932.445068:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445069:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445071:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920853 00000100:00100000:0.0:1705683932.445088:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3320:3083:x1788538584516032:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.445205:0:15148:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x95ff:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445207:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x95ff:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445208:0:15148:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x95ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445210:0:15148:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x95ff:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445211:0:15148:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x95ff:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.445231:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3322:3083:x1788538584516032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (184us total) trans 4295348323 rc 0/0 00000100:00100000:0.0:1705683932.445234:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920853 00000100:00100000:0.0:1705683932.445274:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.445279:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445280:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445285:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641033536 00010000:00010000:0.0:1705683932.445293:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e1b80/0xefc4487a01807332 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2226 expref: 3973 pid: 14278 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.445304:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445305:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445308:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332998 00000100:00100000:0.0:1705683932.445312:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:1857:x1788538641033536:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.445317:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.445319:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e1b80/0xefc4487a01807332 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86f6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2226 expref: 3973 pid: 14278 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.445325:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e3e1b80/0xefc4487a01807332 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2226 expref: 3973 pid: 14278 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.445334:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.445346:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:1857:x1788538641033536:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 33us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.445350:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332998 00000100:00100000:0.0:1705683932.445361:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445362:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445365:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584516288 00000100:00100000:0.0:1705683932.445373:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445374:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445376:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920855 00000100:00100000:0.0:1705683932.445379:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3322:3081:x1788538584516288:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1705683932.445496:0:15148:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445498:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9600:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445499:0:15148:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9600:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445500:0:15148:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9600:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1705683932.445501:0:15148:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9600:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.445523:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3323:3081:x1788538584516288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (225us total) trans 4295348324 rc 0/0 00000100:00100000:0.0:1705683932.445528:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920855 00000100:00100000:0.0:1705683932.445559:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584515200:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.445566:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584515264:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.445576:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.445582:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.445582:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.445584:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445589:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445590:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445593:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584516352 00000100:00100000:0.0:1705683932.445603:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445603:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.445606:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920856 00000100:00100000:0.0:1705683932.445609:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f39400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3323:3081:x1788538584516352:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.445618:0:15148:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34556 count 1 00000004:00080000:0.0:1705683932.445766:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880133211900/2, rc 0, transno 381029 00000100:00100000:0.0:1705683932.445779:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133211900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584514816:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.445790:0:15148:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.445798:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3970 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.445803:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5933 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.445808:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.445809:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.445810:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.445823:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5933 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.445829:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5933 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.445841:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584516480:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.445862:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3970 pid: 15116 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.445869:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3970 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.445875:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584516544:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.445887:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.446019:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446031:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446042:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446140:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446141:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446147:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333003 00000100:00100000:0.0:1705683932.446150:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133216e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1857:x1788538641033920:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.446156:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.446159:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d9da800/0xefc4487a0180739b lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2273 expref: 3970 pid: 15192 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.446166:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d9da800/0xefc4487a0180739b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2273 expref: 3970 pid: 15192 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.446175:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.446186:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133216e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1857:x1788538641033920:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.446191:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333003 00010000:00010000:0.0:1705683932.446209:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446215:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446220:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446224:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.446230:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.446232:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.446362:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3326:3081:x1788538584514944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4598us (4700us total) trans 4295348328 rc 0/0 00000100:00100000:0.0:1705683932.446367:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920843 00000100:00100000:0.0:1705683932.446375:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446375:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446379:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584516800 00000100:00100000:0.0:1705683932.446389:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446390:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446392:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920859 00000100:00100000:0.0:1705683932.446395:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f3c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3326:3081:x1788538584516800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1705683932.446445:0:15192:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34558 count 1 00010000:00010000:0.0:1705683932.446614:0:15192:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446626:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3967 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.446632:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5932 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.446636:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.446637:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.446638:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446650:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5932 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.446657:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5932 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.446664:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584516992:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.446680:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3967 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.446686:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.446692:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584517120:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.446701:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182480 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.446724:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.446726:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446732:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d2d00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.446733:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446737:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446745:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446749:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d2d00/0xefc4487a01878c29 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446760:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.446760:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.446761:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.446785:0:15116:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133212800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_043:lustre-OST0000_UUID:15116:1788538584515712:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.446798:0:15116:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a3d3980/0xefc4487a01878c76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011b8 expref: 3457 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.446805:0:15116:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a3d3980, rc 0) 00000100:00100000:0.0:1705683932.446822:0:15116:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c90a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3457:16415:x1788538641032960:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 3567us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.446828:0:15116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920849 00000100:00100000:0.0:1705683932.446846:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446883:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446894:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446905:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446919:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.446926:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446927:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446931:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641033984 00010000:00010000:0.0:1705683932.446941:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6aaa80/0xefc4487a0181e854 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d98e0 expref: 3534 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.446952:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446953:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.446956:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333006 00000100:00100000:0.0:1705683932.446959:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5932:1856:x1788538641034112:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.446964:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.446966:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5932 pid: 15220 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.446973:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5932 pid: 15220 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.446983:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.446995:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5932:1856:x1788538641034112:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.447000:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333006 00000100:00100000:0.0:1705683932.447009:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447010:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447013:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333008 00000100:00100000:0.0:1705683932.447015:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641034048:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.447021:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.447023:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc9b480/0xefc4487a017f4e5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca465 expref: 3968 pid: 15224 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.447029:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc9b480/0xefc4487a017f4e5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca465 expref: 3968 pid: 15224 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.447046:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447047:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447050:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1058a00/0xefc4487a01878c7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011c6 expref: 5931 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447055:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1058a00/0xefc4487a01878c7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011c6 expref: 5931 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447067:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1058a00/0xefc4487a01878c7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011c6 expref: 5931 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.447074:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584517312:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.447152:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.447187:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.447196:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447197:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447200:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034240 00010000:00010000:0.0:1705683932.447208:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.447219:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447219:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447222:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333009 00000100:00100000:0.0:1705683932.447225:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3969:1856:x1788538641034240:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.447230:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.447232:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.447238:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.447249:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447250:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447251:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447308:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447319:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.447333:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641034240:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 106us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.447338:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333009 00000004:00080000:0.0:1705683932.447360:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801315d9400/2, rc 0, transno 381034 00000100:00100000:0.0:1705683932.447366:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315d9400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584515392:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.447391:0:3084:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584517440:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.447427:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447428:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447433:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584517376 00000100:00100000:0.0:1705683932.447450:0:3084:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.447451:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447452:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447455:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59894 00000100:00100000:3.0:1705683932.447457:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f3ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14222:x1788538584517376:12345-0@lo:1000:mdt00_018.0 00000100:00100000:0.0:1705683932.447483:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.447505:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.447514:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14222:x1788538584517376:12345-0@lo:1000:mdt00_018.0 Request processed in 56us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.447519:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59894 00000100:00100000:0.0:1705683932.447524:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.447541:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.447615:0:15173:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447616:0:15173:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.447624:0:15173:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920864 00000100:00100000:0.0:1705683932.447627:0:15173:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3457:6521:x1788538641034560:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.447633:0:15173:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.447783:0:14282:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63e9180/0xefc4487a0185a2f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e47 expref: 5930 pid: 15220 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.447790:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133630f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584515904:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.447795:0:14282:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073c77480/0xefc4487a018073cc lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d228f expref: 3968 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.447801:0:14282:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:14282:1788538584515968:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.447814:0:14282:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00100000:3.0:1705683932.447819:0:14282:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.447820:0:14282:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.447820:0:14282:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:3.0:1705683932.447821:0:14282:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.447824:0:14282:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.447834:0:14282:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.447836:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.447836:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.447838:0:14282:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.447840:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920865 00000100:00100000:1.0:1705683932.447842:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:4708:x1788538641034624:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.447846:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.447846:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447847:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447851:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584517632 00010000:00010000:1.0:1705683932.447875:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011db expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.447884:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5929 pid: 15148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.447886:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.447887:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.447887:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.447888:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011db expref: 3968 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447890:0:15173:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b278000/0xefc4487a01878cd1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011d4 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.447895:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5929 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.447898:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5929 pid: 15148 timeout: 805 lvb_type: 1 00002000:00010000:0.0:1705683932.447901:0:15173:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.447901:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099c97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584517696:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.447901:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.447905:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59895 00000100:00100000:1.0:1705683932.447910:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345180 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.447916:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.447917:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.447920:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920866 00000100:00100000:3.0:1705683932.447920:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c93700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:14222:x1788538584517632:12345-0@lo:101:mdt00_018.0 00000100:00100000:1.0:1705683932.447922:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3535:7259:x1788538641034688:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.447926:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.447927:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.447946:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878cc3 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447966:0:15173:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447967:0:15173:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.447969:0:15173:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b278000/0xefc4487a01878cd1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011d4 expref: 3458 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447977:0:15173:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b278000/0xefc4487a01878cd1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011d4 expref: 3458 pid: 15173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.447983:0:15173:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b278000, rc 0) 00010000:00010000:3.0:1705683932.447986:0:14256:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1799 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.447992:0:14256:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 4/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.447997:0:15173:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3458:6521:x1788538641034560:12345-192.168.203.41@tcp:101:dd.0 Request processed in 369us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.448002:0:15173:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920864 00010000:00010000:3.0:1705683932.448020:0:14256:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1799 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.448026:0:14256:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1799 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.448037:0:14256:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:14256:1788538584517760:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.448039:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.448053:0:14256:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.448061:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.448114:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801332b9900/0xefc4487a01878cdf lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011e2 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.448121:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.448126:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.448127:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.448129:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801332b9900/0xefc4487a01878cdf lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e2 expref: 3536 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448133:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801332b9900/0xefc4487a01878cdf lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e2 expref: 3536 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.448134:0:14282:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1705683932.448136:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801332b9900, rc 0) 00000100:00100000:1.0:1705683932.448160:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:7259:x1788538641034688:12345-192.168.203.41@tcp:101:dd.0 Request processed in 238us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.448161:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.448163:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920866 00000100:00100000:1.0:1705683932.448169:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448169:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448171:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034752 00000100:00100000:1.0:1705683932.448182:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448182:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448184:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920867 00000100:00100000:0.0:1705683932.448186:0:15173:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448186:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:6554:x1788538641034752:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.448187:0:15173:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.448189:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.448192:0:15126:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448193:0:15126:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.448204:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011e9 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.448209:0:15126:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034880 00010000:00010000:1.0:1705683932.448212:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3537 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.448215:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.448216:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.448216:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e9 expref: 3537 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.448220:0:15126:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419266/34535 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.448222:0:15126:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b24600 with x1788538641034880 ext(0->18446744073709551615) 00010000:00010000:1.0:1705683932.448225:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3537 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.448228:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3537 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.448232:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099c96400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584517824:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.448241:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c300 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.448247:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1705683932.448249:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448252:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a15cf700 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:1.0:1705683932.448253:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448256:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448262:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448264:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a15cf700/0xefc4487a01878c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.448266:0:15126:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b24600. 00010000:00010000:1.0:1705683932.448271:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.448272:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.448272:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1705683932.448275:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448275:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448277:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584516480:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.448278:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034496 00000100:00100000:3.0:1705683932.448286:0:15126:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448287:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448287:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448287:0:15126:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448288:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034816 00000100:00100000:3.0:1705683932.448291:0:15126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150736 00000100:00100000:1.0:1705683932.448293:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448293:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448295:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413425 00000100:00100000:1.0:1705683932.448297:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1897:7346:x1788538641034496:12345-192.168.203.41@tcp:36:touch.0 00000100:00100000:3.0:1705683932.448307:0:15126:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b24600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3458:1855:x1788538641034880:12345-192.168.203.41@tcp:10:dd.0 00010000:00010000:1.0:1705683932.448308:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.448314:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1058280/0xefc4487a01878c5a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x425d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011b1 expref: 1897 pid: 6531 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.448315:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584516544:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.448318:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425d:0x0].0x0 (ffff88009ba2bf00) 00010000:00010000:1.0:1705683932.448324:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.448328:0:15148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.448334:0:15148:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.448334:0:15148:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.448335:0:15148:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448367:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584516992:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.448406:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8c80/0xefc4487a01878ced lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:1.0:1705683932.448409:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8c80/0xefc4487a01878ced lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.448413:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8c80/0xefc4487a01878ced lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00002000:00010000:3.0:1705683932.448429:0:15126:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000402:0x86e7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448431:0:15126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000402:0x86e7:0x0] updating lvb mtime from disk: 1705683931 -> 1705683933 00002000:00010000:3.0:1705683932.448433:0:15126:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000402:0x86e7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448434:0:15126:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000402:0x86e7:0x0] updating lvb ctime from disk: 1705683931 -> 1705683933 00002000:00010000:3.0:1705683932.448435:0:15126:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000402:0x86e7:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1705683932.448448:0:6531:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8800a5b21e00 reply state ffff88012deab000 transno 4295084972 ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8c80/0xefc4487a01878ced lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.448452:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8c80/0xefc4487a01878ced lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x425d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.448455:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425d:0x0].0x0 (ffff880131c82f00) 00010000:00010000:1.0:1705683932.448455:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1705683932.448462:0:15126:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b24600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3459:1855:x1788538641034880:12345-192.168.203.41@tcp:10:dd.0 Request processed in 155us (301us total) trans 4295340569 rc 0/0 00000100:00100000:3.0:1705683932.448467:0:15126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150736 00002000:00010000:3.0:1705683932.448469:0:15126:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419266/34535 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.448471:0:15126:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b24600 with x1788538641034880 ext(0->18446744073709551615) 00000100:00100000:1.0:1705683932.448476:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1898:7346:x1788538641034496:12345-192.168.203.41@tcp:36:touch.0 Request processed in 178us (994us total) trans 4295084972 rc 0/0 00002000:00010000:3.0:1705683932.448477:0:15126:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b24600. 00000100:00100000:1.0:1705683932.448479:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413425 00000100:00100000:1.0:1705683932.448485:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448486:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448488:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413426 00000100:00100000:1.0:1705683932.448489:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1897:7345:x1788538641034816:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:1.0:1705683932.448493:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.448496:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801332ba080/0xefc4487a01878cf4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x425c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011f0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448519:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801332ba080/0xefc4487a01878cf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x425c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011f0 expref: 1898 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448523:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332ba080/0xefc4487a01878cf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x425c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011f0 expref: 1898 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.448530:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425c:0x0].0x0 (ffff880131c82800) 00010000:00010000:1.0:1705683932.448531:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1705683932.448532:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801332ba080, rc 0) 00000100:00100000:1.0:1705683932.448598:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1898:7345:x1788538641034816:12345-192.168.203.41@tcp:101:touch.0 Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.448600:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413426 00000100:00100000:1.0:1705683932.448617:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584516160:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.448620:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f38f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584516224:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.448630:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:1.0:1705683932.448634:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.448634:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.448635:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448642:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f38a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584516672:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.448649:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584517056:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.448652:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3b200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584517184:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.448658:0:14216:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00100000:1.0:1705683932.448661:0:14216:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.448661:0:14216:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.448662:0:14216:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448684:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584517120:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.448694:0:15192:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00100000:0.0:1705683932.448699:0:15192:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.448700:0:15192:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.448700:0:15192:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448700:0:14282:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+3330:3081:x1788538584515840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5010us (5069us total) trans 4295348331 rc 0/0 00000004:00080000:1.0:1705683932.448704:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099c94b00/2, rc 0, transno 381035 00000100:00100000:3.0:1705683932.448706:0:14282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920852 00000100:00100000:1.0:1705683932.448716:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c94b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584515840:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1705683932.448733:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099c97300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584517888:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1705683932.448744:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.448746:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.448753:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448754:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448758:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641034944 00010000:00010000:0.0:1705683932.448767:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013303c000/0xefc4487a0185a32c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e5c expref: 5930 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.448778:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448779:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448780:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448781:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448782:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333010 00000100:00100000:0.0:1705683932.448785:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:1856:x1788538641034944:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.448786:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448787:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448790:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584517888 00010000:00010000:0.0:1705683932.448791:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.448793:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013303c000/0xefc4487a0185a32c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e5c expref: 5930 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.448799:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013303c000/0xefc4487a0185a32c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e5c expref: 5930 pid: 15122 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.448808:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013303c000/0xefc4487a0185a32c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e5c expref: 5930 pid: 15122 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.448813:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.448816:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.448823:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.448827:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920868 00000100:00100000:0.0:1705683932.448830:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:1856:x1788538641034944:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.448830:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f3b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3330:3081:x1788538584517888:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.448834:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333010 00000100:00100000:1.0:1705683932.448840:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.448851:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448852:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448855:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035072 00000100:00100000:1.0:1705683932.448855:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.448859:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448859:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448861:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035328 00010000:00010000:0.0:1705683932.448862:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5929 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.448867:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800988aca00/0xefc4487a0185a309 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ea2 expref: 5930 pid: 15170 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.448872:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.448873:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448873:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448874:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448875:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333011 00000100:00100000:1.0:1705683932.448877:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f3f300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:1856:x1788538641035072:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.448878:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333012 00010000:00010000:1.0:1705683932.448880:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.448881:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:1856:x1788538641035328:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.448882:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5930 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.448885:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5930 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.448886:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.448889:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800988aca00/0xefc4487a0185a309 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ea2 expref: 5930 pid: 15170 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.448891:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bff700/0xefc4487a0185a2c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8e94 expref: 5930 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.448894:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800988aca00/0xefc4487a0185a309 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ea2 expref: 5929 pid: 15170 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.448898:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.448903:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800988aca00/0xefc4487a0185a309 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ea2 expref: 5929 pid: 15170 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.448904:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3f300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:1856:x1788538641035072:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 26us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.448907:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333011 00010000:00010000:0.0:1705683932.448912:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1705683932.448953:0:15223:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9603:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448955:0:15223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9603:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448956:0:15223:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9603:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448957:0:15223:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9603:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.448958:0:15223:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9603:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1705683932.448982:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.448986:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5927:1856:x1788538641035328:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 103us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.448986:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448986:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448989:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035392 00000100:00100000:0.0:1705683932.448991:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333012 00010000:00010000:1.0:1705683932.448993:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c5f980/0xefc4487a0185a372 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ec5 expref: 5928 pid: 15118 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.448998:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.448999:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449000:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333013 00000100:00100000:0.0:1705683932.449001:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449001:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449002:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5927:1855:x1788538641035392:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.449005:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.449005:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c5f980/0xefc4487a0185a372 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ec5 expref: 5927 pid: 15118 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449009:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c5f980/0xefc4487a0185a372 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ec5 expref: 5927 pid: 15118 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449014:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c5f980/0xefc4487a0185a372 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ec5 expref: 5927 pid: 15118 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449018:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.449024:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:1855:x1788538641035392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 21us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.449026:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333013 00000100:00100000:0.0:1705683932.449030:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.449036:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449036:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449038:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035008 00000100:00100000:3.0:1705683932.449040:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:lustre-MDT0001-mdtlov_UUID+3331:3081:x1788538584517888:12345-0@lo:2:osp-syn-1-1.0 Request processed in 209us (295us total) trans 4295348332 rc 0/0 00010000:00010000:1.0:1705683932.449041:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cca00/0xefc4487a018073ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ab expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.449050:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.449054:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449055:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449056:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035264 00000100:00100000:3.0:1705683932.449057:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920868 00010000:00010000:1.0:1705683932.449059:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5926 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.449060:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449060:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449064:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333014 00000100:00100000:1.0:1705683932.449064:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449065:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449066:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333015 00000100:00100000:0.0:1705683932.449068:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3969:1856:x1788538641035008:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.449073:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.449075:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800737cca00/0xefc4487a018073ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ab expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449080:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:1855:x1788538641035264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.449083:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.449084:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5926 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449088:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5926 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449093:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e32580/0xefc4487a0185a325 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eb7 expref: 5926 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449097:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.449098:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800737cca00/0xefc4487a018073ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ab expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449104:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:1855:x1788538641035264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 35us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.449106:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333015 00000004:00080000:3.0:1705683932.449111:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099c97300/2, rc 0, transno 381036 00010000:00010000:0.0:1705683932.449113:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800737cca00/0xefc4487a018073ef lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ab expref: 3969 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.449116:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c97300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584517888:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.449121:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.449123:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.449124:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449128:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.449128:0:3081:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1705683932.449131:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880131f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584517952:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.449140:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.449141:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.449144:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.449144:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.449150:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.449154:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641035008:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 86us (124us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.449154:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449156:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.449157:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584517952 00000100:00100000:0.0:1705683932.449158:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333014 00010000:00010000:1.0:1705683932.449159:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449168:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1705683932.449172:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.449174:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.449179:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a105b480 already unused, calling callback (ffffffffa0664e00) 00000100:00100000:0.0:1705683932.449187:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.449195:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449195:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.449195:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.449199:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035200 00010000:00010000:3.0:1705683932.449204:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449205:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3968 pid: 15116 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.449212:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.449214:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449215:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449217:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333016 00000100:00100000:0.0:1705683932.449220:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641035200:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.449224:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c95000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3332:3083:x1788538584516096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4103us (4127us total) trans 4295348333 rc 0/0 00010000:00010000:0.0:1705683932.449225:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.449227:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3968 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449227:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920854 00010000:00010000:3.0:1705683932.449228:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a105b480/0xefc4487a01878c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449233:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3968 pid: 15116 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449233:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449233:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449235:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920869 00000100:00100000:1.0:1705683932.449237:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880131f38500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3331:3081:x1788538584517952:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.449241:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f102f80/0xefc4487a01807412 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22c7 expref: 3968 pid: 15116 timeout: 805 lvb_type: 1 00002000:00080000:1.0:1705683932.449243:0:15133:0:(ofd_dev.c:1773:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000402:34561 count 1 00010000:00010000:0.0:1705683932.449248:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.449248:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.449249:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.449249:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.449250:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.449250:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.449254:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449264:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.449277:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:1856:x1788538641035200:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 56us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.449281:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333016 00010000:00010000:0.0:1705683932.449292:0:15148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449296:0:15148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449300:0:15148:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449304:0:15148:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449311:0:15148:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1705683932.449346:0:15133:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449352:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3966 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.449358:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5924 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.449360:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.449361:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.449361:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 5/0,1 mode: --/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449370:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5924 pid: 15105 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.449374:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5924 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449377:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584518016:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.449389:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3966 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.449392:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3966 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.449395:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584518080:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.449400:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a60da300 going to sleep for 11 seconds 00000004:00080000:1.0:1705683932.449410:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099c92800/2, rc 0, transno 381037 00000100:00100000:1.0:1705683932.449414:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c92800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584516096:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.449435:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f39400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+3332:3081:x1788538584516352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3825us (3850us total) trans 4295348334 rc 0/0 00000004:00080000:1.0:1705683932.449436:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131f3a300/2, rc 0, transno 381038 00000100:00100000:1.0:1705683932.449437:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584516352:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.449440:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920856 00000100:00100000:1.0:1705683932.449447:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.449453:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1705683932.449454:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.449455:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449459:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d0500 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.449460:0:8828:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.449461:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.449463:0:8828:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.449464:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449465:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449468:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035136 00010000:00010000:0.0:1705683932.449469:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449474:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d0500/0xefc4487a01878c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.449476:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449477:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449479:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413427 00000100:00100000:1.0:1705683932.449480:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7306:x1788538641035136:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:1.0:1705683932.449484:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.449513:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b9e00/0xefc4487a01878d02 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011f7 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449520:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.449521:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.449522:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.449525:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449526:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449529:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035520 00010000:00010000:0.0:1705683932.449536:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.449550:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449551:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449554:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035456 00010000:00010000:0.0:1705683932.449559:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d2c8a00/0xefc4487a0180746d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d231b expref: 3968 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.449564:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449564:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449565:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.449565:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449566:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333017 00000100:00100000:0.0:1705683932.449568:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc18500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1855:x1788538641035520:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.449569:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333018 00000100:00100000:1.0:1705683932.449571:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641035456:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.449572:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.449573:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3968 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449575:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.449577:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3968 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449577:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d2c8a00/0xefc4487a0180746d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d231b expref: 3968 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449581:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d2c8a00/0xefc4487a0180746d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d231b expref: 3968 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.449587:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073544280/0xefc4487a01807443 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22ff expref: 3968 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.449591:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d2c8a00/0xefc4487a0180746d lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d231b expref: 3967 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.449593:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.449593:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.449594:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449596:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.449596:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.449597:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449597:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449600:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449605:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.449607:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.449617:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc18500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:1855:x1788538641035520:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.449617:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:1856:x1788538641035456:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.449619:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333017 00000100:00100000:1.0:1705683932.449621:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333018 00010000:00010000:1.0:1705683932.449630:0:14216:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449631:0:15192:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449633:0:14216:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449636:0:15192:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449636:0:14216:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449638:0:14216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449639:0:15192:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.449642:0:15192:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449645:0:14216:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1705683932.449648:0:15192:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1705683932.449649:0:6521:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1705683932.449650:0:6521:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449653:0:6521:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801332baa80 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:1.0:1705683932.449654:0:6521:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449656:0:6521:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449660:0:6521:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449662:0:6521:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332baa80/0xefc4487a01878cae lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449668:0:6521:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1705683932.449669:0:6521:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449671:0:6521:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a3d1680 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:1.0:1705683932.449672:0:6521:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449677:0:6521:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449680:0:6521:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449682:0:6521:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a3d1680/0xefc4487a01878ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.449688:0:6521:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.449688:0:6521:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.449689:0:6521:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.449690:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.449729:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+3333:3081:x1788538584516800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3333us (3360us total) trans 4295348335 rc 0/0 00000100:00100000:0.0:1705683932.449734:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920859 00000004:00080000:0.0:1705683932.449751:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131f3a800/2, rc 0, transno 381039 00000100:00100000:0.0:1705683932.449753:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3a800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584516800:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1705683932.449758:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f39900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+3332:3083:x1788538584516928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3237us (3256us total) trans 4295348336 rc 0/0 00000100:00100000:1.0:1705683932.449761:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920861 00000004:00080000:1.0:1705683932.449773:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131f3e400/2, rc 0, transno 381040 00000100:00100000:1.0:1705683932.449775:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3e400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584516928:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1705683932.449783:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584517248:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.449790:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.449798:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584517312:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.449798:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:1856:x1788538641033984:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2835us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.449800:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333007 00010000:00010000:0.0:1705683932.449806:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.449808:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.449815:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.449816:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:1856:x1788538641034048:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2800us (2897us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.449818:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.449821:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333008 00000100:00100000:0.0:1705683932.449852:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.449882:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00000100:00100000:0.0:1705683932.449885:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.449885:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449887:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.449891:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449892:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.449894:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035584 00000100:00100000:0.0:1705683932.449903:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920870 00000100:00100000:0.0:1705683932.449905:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3459:16443:x1788538641035584:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.449911:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.449929:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.449932:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449934:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000004:00200000:1.0:1705683932.449946:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41ef:0x0]: returning size 4096 00000004:00200000:1.0:1705683932.449948:0:8825:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1705683932.449954:0:8825:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449958:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449960:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449964:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449966:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449968:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801332b8280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.449969:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449971:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449974:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:1.0:1705683932.449975:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.449976:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449977:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b8280/0xefc4487a01878d09 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449981:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449983:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449985:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449987:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098afb200 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.449988:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449991:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449993:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880136254100) 00010000:00010000:1.0:1705683932.449994:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.449995:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.449996:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb200/0xefc4487a01878d10 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.450003:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3011fe expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450012:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450013:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801332b9e00/0xefc4487a01878d02 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011f7 expref: 1802 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450017:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.450018:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.450018:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011f7 expref: 1801 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450019:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011fe expref: 3460 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450020:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff8801353cbc00) 00010000:00010000:1.0:1705683932.450021:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1705683932.450021:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098afad00, rc 0) 00010000:00010000:0.0:1705683932.450030:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.450031:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1801:7306:x1788538641035136:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 550us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450033:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413427 00010000:00010000:0.0:1705683932.450038:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.450046:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584518144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.450049:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c93200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584517504:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.450052:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c92d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584517568:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.450060:0:15215:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450061:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab780 going to sleep for 11 seconds 00010000:00100000:1.0:1705683932.450065:0:15215:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.450066:0:15215:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.450067:0:15215:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450068:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450069:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450070:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450071:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450072:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035648 00000100:00100000:0.0:1705683932.450102:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450102:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450102:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450103:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450105:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920871 00000100:00100000:1.0:1705683932.450107:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:6496:x1788538641035648:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.450111:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.450119:0:14256:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:14256:1788538584517760:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.450130:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.450136:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x0 (ffff88012b17cc00) 00010000:00010000:3.0:1705683932.450138:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.450139:0:14256:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.450144:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15cdb80, rc 0) 00000100:00100000:0.0:1705683932.450156:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.450162:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c93700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:14222:x1788538584517632:12345-0@lo:101:mdt00_018.0 Request processed in 2253us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.450163:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450163:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.450166:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59895 00000100:00100000:0.0:1705683932.450167:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035840 00000100:00100000:0.0:1705683932.450175:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450176:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450179:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920872 00000100:00100000:0.0:1705683932.450182:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133212800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:6521:x1788538641035840:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.450187:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.450217:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c94600 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584517632:0@lo:101:mdt00_018.0 00010000:00010000:3.0:1705683932.450233:0:14222:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.450239:0:14222:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450283:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098afaf80/0xefc4487a01878d25 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301205 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.450290:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.450296:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.450296:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.450298:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098afaf80/0xefc4487a01878d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301205 expref: 3965 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450302:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098afaf80/0xefc4487a01878d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301205 expref: 3965 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450306:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098afaf80, rc 0) 00000100:00100000:1.0:1705683932.450314:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:6496:x1788538641035648:12345-192.168.203.41@tcp:101:dd.0 Request processed in 206us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450317:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920871 00000100:00100000:1.0:1705683932.450329:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584517696:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.450337:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011db expref: 3964 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450342:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801332b9b80, rc 0) 00000100:00100000:1.0:1705683932.450347:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:4708:x1788538641034624:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2505us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450350:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920865 00000100:00100000:1.0:1705683932.450359:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099c96400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584517824:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.450366:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e9 expref: 3536 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450370:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801332ba580, rc 0) 00000100:00100000:1.0:1705683932.450375:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:6554:x1788538641034752:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2189us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450377:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920867 00000100:00100000:1.0:1705683932.450391:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.450396:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450396:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450399:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035904 00010000:00010000:0.0:1705683932.450404:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b278c80/0xefc4487a01878d2c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x936f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30120c expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.450406:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450406:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450408:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413428 00000100:00100000:1.0:1705683932.450409:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1898:7346:x1788538641035904:12345-192.168.203.41@tcp:101:touch.0 00002000:00010000:0.0:1705683932.450414:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x936f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.450414:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.450417:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8a00/0xefc4487a01878d33 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x425d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301213 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450420:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.450421:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.450423:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b278c80/0xefc4487a01878d2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x936f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30120c expref: 5926 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450430:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b278c80/0xefc4487a01878d2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x936f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30120c expref: 5926 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450432:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8a00/0xefc4487a01878d33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x425d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301213 expref: 1899 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450434:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b278c80, rc 0) 00010000:00010000:1.0:1705683932.450435:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8a00/0xefc4487a01878d33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x425d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301213 expref: 1899 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450440:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425d:0x0].0x0 (ffff880131c82f00) 00010000:00010000:1.0:1705683932.450441:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1705683932.450441:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af8a00, rc 0) 00000100:00100000:0.0:1705683932.450448:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:6521:x1788538641035840:12345-192.168.203.41@tcp:101:dd.0 Request processed in 265us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450449:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1899:7346:x1788538641035904:12345-192.168.203.41@tcp:101:touch.0 Request processed in 39us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.450451:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920872 00000100:00100000:1.0:1705683932.450451:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413428 00000100:00100000:1.0:1705683932.450467:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.450479:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450480:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450484:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036032 00010000:00010000:0.0:1705683932.450490:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3536 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.450490:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.450496:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450497:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450497:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450498:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450499:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450499:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450499:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035776 00000100:00100000:0.0:1705683932.450501:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333019 00000100:00100000:0.0:1705683932.450503:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:1856:x1788538641036032:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.450504:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f101b80/0xefc4487a01807474 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2337 expref: 3964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450506:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.450510:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450511:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450512:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333020 00010000:00010000:0.0:1705683932.450513:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3536 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.450514:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:1854:x1788538641035776:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.450517:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.450518:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3536 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.450518:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f101b80/0xefc4487a01807474 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2337 expref: 3964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.450525:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f101b80/0xefc4487a01807474 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2337 expref: 3964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450526:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a634ea80/0xefc4487a01863584 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1e8 expref: 3536 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450531:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.450531:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.450531:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f101b80/0xefc4487a01807474 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2337 expref: 3964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450533:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e9 expref: 3535 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450535:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.450538:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e9 expref: 3535 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.450541:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:1854:x1788538641035776:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 27us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.450544:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333020 00010000:00010000:0.0:1705683932.450551:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801332ba580/0xefc4487a01878ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011e9 expref: 3535 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450556:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584518208:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.450561:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.450565:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450566:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450568:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036096 00010000:00010000:1.0:1705683932.450571:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5926 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.450572:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.450576:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450577:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450577:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450578:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450578:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333021 00000100:00100000:1.0:1705683932.450580:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc19400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:1854:x1788538641036096:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.450583:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.450587:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5926 pid: 15148 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.450590:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5926 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.450592:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.450597:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c9d680/0xefc4487a01847a2a lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecc9a expref: 5926 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.450599:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450600:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450602:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035712 00010000:00010000:1.0:1705683932.450602:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.450603:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.450604:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011db expref: 3962 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450607:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011db expref: 3962 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450608:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999f9e00/0xefc4487a0185a387 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ee1 expref: 5926 pid: 15220 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.450615:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801332b9b80/0xefc4487a01878cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011db expref: 3962 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450617:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450618:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450619:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584518272:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.450621:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333022 00000100:00100000:0.0:1705683932.450623:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:1854:x1788538641035712:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.450627:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.450628:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999f9e00/0xefc4487a0185a387 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ee1 expref: 5926 pid: 15220 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.450628:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.450632:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999f9e00/0xefc4487a0185a387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ee1 expref: 5926 pid: 15220 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450640:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999f9e00/0xefc4487a0185a387 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8700:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8ee1 expref: 5926 pid: 15220 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.450648:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.450649:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.450650:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450654:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450670:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.450680:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.450687:0:15215:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450690:0:15215:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.450693:0:15215:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450697:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:1854:x1788538641035712:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 73us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.450698:0:15215:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450700:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333022 00010000:00010000:1.0:1705683932.450716:0:15215:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1705683932.450717:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450718:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450726:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641035968 00010000:00010000:0.0:1705683932.450734:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1801 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.450737:0:15119:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.450739:0:15119:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450749:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450749:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450750:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450750:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450753:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333023 00000100:00100000:0.0:1705683932.450756:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1801:1854:x1788538641035968:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.450760:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.450761:0:15119:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801332bbc00 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:0.0:1705683932.450762:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1801 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.450767:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1801 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.450770:0:15119:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.450774:0:15119:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450776:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801332d0500/0xefc4487a018776a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300ad4 expref: 1801 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.450782:0:15119:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450783:0:15209:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x0 (ffff88012b17cc00) 00010000:00010000:0.0:1705683932.450786:0:15209:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 39 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.450787:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:lustre-MDT0001-mdtlov_UUID+3332:3084:x1788538584517440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3178us (3337us total) trans 4295348337 rc 0/0 00000100:00100000:1.0:1705683932.450790:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920863 00010000:00010000:0.0:1705683932.450791:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 39 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450795:0:15209:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 39 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.450796:0:15119:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332bbc00/0xefc4487a01878cbc lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1705683932.450803:0:3084:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880133216e00/2, rc 0, transno 381041 00000100:00100000:1.0:1705683932.450805:0:3084:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133216e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3084:1788538584517440:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1705683932.450807:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 39 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450814:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fbdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001_UUID:15209:1788538584518336:0@lo:105: 00000100:00100000:1.0:1705683932.450823:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.450825:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.450826:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1705683932.450827:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.450827:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1705683932.450828:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450830:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036160 00000100:00100000:0.0:1705683932.450831:0:15209:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1705683932.450835:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450836:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.450837:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920873 00000100:00100000:1.0:1705683932.450839:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:1855:x1788538641036160:12345-192.168.203.41@tcp:2:touch.0 00000100:00100000:0.0:1705683932.450840:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182480 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.450846:0:11003:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450847:0:11003:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450851:0:11003:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518336 00000100:00100000:0.0:1705683932.450866:0:11003:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450867:0:11003:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.450870:0:11003:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15258 00000100:00100000:0.0:1705683932.450873:0:11003:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15209:x1788538584518336:12345-0@lo:105: 00010000:00010000:0.0:1705683932.450877:0:11003:0:(ldlm_lockd.c:2544:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450882:0:11003:0:(ldlm_lockd.c:2002:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450886:0:11003:0:(ldlm_lockd.c:2079:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450891:0:11003:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450894:0:11003:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450897:0:11003:0:(ldlm_lockd.c:2107:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.450913:0:11003:0:(ldlm_lockd.c:2118:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8801332b8780) 00000100:00100000:0.0:1705683932.450931:0:11003:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:15209:x1788538584518336:12345-0@lo:105: Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.450935:0:11003:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15258 00010000:00010000:3.0:1705683932.450953:0:14222:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.450956:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fbdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001_UUID:15209:1788538584518336:0@lo:105: 00010000:00010000:0.0:1705683932.450966:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.450977:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:1854:x1788538641035968:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 220us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.450981:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333023 00010000:00010000:3.0:1705683932.450986:0:14222:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.450993:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:1855:x1788538641036160:12345-192.168.203.41@tcp:2:touch.0 Request processed in 152us (169us total) trans 4295348338 rc 0/0 00000100:00100000:1.0:1705683932.450996:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920873 00000100:00100000:0.0:1705683932.451032:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000004:00080000:3.0:1705683932.451033:0:14222:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x19d:0x0] 00000100:00100000:1.0:1705683932.451043:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.451044:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.451047:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036224 00000100:00100000:1.0:1705683932.451054:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.451054:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.451056:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920874 00000100:00100000:1.0:1705683932.451058:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:7259:x1788538641036224:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.451062:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.451071:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.451102:0:14222:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.451108:0:14222:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14222 initiator: MDT0 00000100:00100000:3.0:1705683932.451116:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518400:0@lo:101:mdt00_018.0 00000100:00100000:3.0:1705683932.451131:0:14222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.451139:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.451145:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451145:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451149:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518400 00000100:00100000:3.0:1705683932.451157:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451158:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.451159:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af9180/0xefc4487a01878d41 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9642:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30121a expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.451160:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59896 00000100:00100000:3.0:1705683932.451163:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133630f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:14222:x1788538584518400:12345-0@lo:101:mdt00_018.0 00002000:00010000:1.0:1705683932.451166:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9642:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.451168:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.451171:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.451172:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.451174:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af9180/0xefc4487a01878d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30121a expref: 3964 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.451178:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af9180/0xefc4487a01878d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30121a expref: 3964 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.451182:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af9180, rc 0) 00000100:00100000:1.0:1705683932.451192:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fbdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:7259:x1788538641036224:12345-192.168.203.41@tcp:101:dd.0 Request processed in 133us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.451195:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920874 00010000:00010000:3.0:1705683932.451263:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd680/0xefc4487a01878d48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878d3a expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.451273:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd680/0xefc4487a01878d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878d3a expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.451285:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cd680/0xefc4487a01878d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878d3a expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.451290:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x35 (ffff88008188e500) 00010000:00010000:3.0:1705683932.451291:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.451292:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a15cd680, rc 0) 00000100:00100000:3.0:1705683932.451329:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133630f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518400:12345-0@lo:101:mdt00_018.0 Request processed in 165us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.451333:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518400:0@lo:101:mdt00_018.0 00010000:00010000:0.0:1705683932.451341:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878d48 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.451346:0:14222:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878d48 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.451350:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59896 00000004:00080000:0.0:1705683932.451425:0:14222:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x19d:0x0] 00000100:00100000:0.0:1705683932.451444:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518464:0@lo:1000:mdt00_018.0 00000100:00100000:0.0:1705683932.451462:0:14222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.451478:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182480 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.451504:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451505:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451523:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518464 00000100:00100000:3.0:1705683932.451561:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.451562:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451562:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.451563:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451566:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59897 00000100:00100000:3.0:1705683932.451569:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518464:12345-0@lo:1000:mdt00_018.0 00000100:00100000:3.0:1705683932.451623:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518464:12345-0@lo:1000:mdt00_018.0 Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.451635:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518464:0@lo:1000:mdt00_018.0 00000100:00100000:3.0:1705683932.451645:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59897 00000100:00100000:0.0:1705683932.451667:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518528:0@lo:1000:mdt00_018.0 00000100:00100000:0.0:1705683932.451723:0:14222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.451732:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181af00 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.451742:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451743:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451747:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518528 00000100:00100000:3.0:1705683932.451830:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.451833:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.451833:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.451834:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.451838:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59898 00000100:00100000:0.0:1705683932.451841:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135574100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518528:12345-0@lo:1000:mdt00_018.0 00000100:00100000:0.0:1705683932.451917:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135574100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518528:12345-0@lo:1000:mdt00_018.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.451922:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59898 00000100:00100000:1.0:1705683932.451952:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a1fba800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518528:0@lo:1000:mdt00_018.0 00000100:00100000:1.0:1705683932.452015:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518592:0@lo:1000:mdt00_018.0 00000100:00100000:1.0:1705683932.452033:0:14222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.452042:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.452050:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c14c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.452051:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452052:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452056:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518592 00000100:00100000:1.0:1705683932.452064:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584518016:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.452083:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584518080:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.452084:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452084:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452087:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59899 00000100:00100000:0.0:1705683932.452089:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc18a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518592:12345-0@lo:1000:mdt00_018.0 00010000:00010000:1.0:1705683932.452095:0:15133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00100000:1.0:1705683932.452100:0:15133:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.452101:0:15133:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.452101:0:15133:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:1.0:1705683932.452106:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.452107:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.452111:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036352 00000100:00100000:0.0:1705683932.452120:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc18a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518592:12345-0@lo:1000:mdt00_018.0 Request processed in 31us (87us total) trans 0 rc 1/1 00000100:00100000:0.0:1705683932.452123:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59899 00000100:00100000:1.0:1705683932.452137:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.452138:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.452141:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920875 00000100:00100000:1.0:1705683932.452143:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:6496:x1788538641036352:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.452150:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.452330:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098afa080/0xefc4487a01878d4f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x838c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301221 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.452340:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x838c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.452347:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.452348:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.452350:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098afa080/0xefc4487a01878d4f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301221 expref: 3537 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.452357:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098afa080/0xefc4487a01878d4f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301221 expref: 3537 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.452362:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098afa080, rc 0) 00000100:00100000:1.0:1705683932.452387:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:6496:x1788538641036352:12345-192.168.203.41@tcp:101:dd.0 Request processed in 242us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.452391:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920875 00000100:00100000:1.0:1705683932.452413:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518592:0@lo:1000:mdt00_018.0 00010000:00010000:1.0:1705683932.452444:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.452448:0:14222:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.452453:0:14222:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.452461:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518656:0@lo:101:mdt00_018.0 00000100:00100000:1.0:1705683932.452476:0:14222:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1705683932.452485:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181af00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.452486:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452487:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452490:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518656 00000100:00100000:0.0:1705683932.452506:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452507:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452509:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59900 00000100:00100000:0.0:1705683932.452511:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:14222:x1788538584518656:12345-0@lo:101:mdt00_018.0 00010000:00010000:0.0:1705683932.452515:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.452580:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009b27b200/0xefc4487a01878d5d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878d56 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.452589:0:14256:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009b27b200/0xefc4487a01878d5d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878d56 expref: 42 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.452595:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009b27b200/0xefc4487a01878d5d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878d56 expref: 42 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.452600:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009a7d0a00) 00010000:00010000:0.0:1705683932.452601:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1705683932.452602:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b27b200, rc 0) 00000100:00100000:0.0:1705683932.452625:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:14222:x1788538584518656:12345-0@lo:101:mdt00_018.0 Request processed in 113us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.452628:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59900 00000100:00100000:1.0:1705683932.452653:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000-mdtlov_UUID:14222:1788538584518656:0@lo:101:mdt00_018.0 00010000:00010000:1.0:1705683932.452662:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.452666:0:14222:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.452682:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.452688:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.452693:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00000100:00100000:0.0:1705683932.452815:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.452837:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584518144:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.452845:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011fe expref: 3460 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.452850:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b279b80, rc 0) 00000100:00100000:0.0:1705683932.452860:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3460:16443:x1788538641035584:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2954us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.452863:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920870 00000100:00100000:0.0:1705683932.452868:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452868:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452870:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036416 00000100:00100000:0.0:1705683932.452875:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452876:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.452877:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920876 00000100:00100000:0.0:1705683932.452879:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3460:6521:x1788538641036416:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.452883:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1705683932.452897:0:14222:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x9e:0x0].994, 416 off816072 00000040:00080000:1.0:1705683932.452931:0:14222:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x7b:0x0].19, 528 off50688 00000004:00080000:1.0:1705683932.452934:0:14222:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008181af00 with version 15024 00000004:00080000:3.0:1705683932.452964:0:7795:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88009266a000 version 15024 rpc_version 15024 00000100:00100000:1.0:1705683932.452976:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f3c100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584516736:192.168.203.41@tcp:104: 00000020:00100000:3.0:1705683932.452991:0:7795:0:(genops.c:2249:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1705683932.452992:0:15110:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00100000:1.0:1705683932.452996:0:15110:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.452997:0:15110:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.452997:0:15110:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.452997:0:7795:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880133633200 x1788538584518784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1705683932.453011:0:7795:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1788538584518784:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1705683932.453048:0:7795:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.453064:0:7795:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.453086:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.453086:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.453092:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518784 00000100:00100000:3.0:1705683932.453106:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.453106:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.453108:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59901 00000100:00100000:3.0:1705683932.453111:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:7795:x1788538584518784:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1705683932.453129:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b278780/0xefc4487a01878d6b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301228 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.453136:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.453143:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.453144:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.453146:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b278780/0xefc4487a01878d6b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301228 expref: 3461 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453154:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b278780/0xefc4487a01878d6b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301228 expref: 3461 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453158:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b278780, rc 0) 00000100:00100000:0.0:1705683932.453170:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3461:6521:x1788538641036416:12345-192.168.203.41@tcp:101:dd.0 Request processed in 290us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.453175:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920876 00000100:00100000:1.0:1705683932.453270:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584518208:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.453281:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.453296:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:1856:x1788538641036032:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2791us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.453301:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333019 00000100:00100000:0.0:1705683932.453316:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.453330:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133630500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:7795:x1788538584518784:12345-0@lo:1000:osp_up1-0.0 Request processed in 218us (282us total) trans 4295084973 rc 0/0 00000100:00100000:3.0:1705683932.453334:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59901 00000100:00100000:1.0:1705683932.453340:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584518272:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.453350:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.453350:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.453367:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc19400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:1854:x1788538641036096:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2785us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.453368:0:7795:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133633200 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1788538584518784:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1705683932.453371:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333021 00000100:00100000:1.0:1705683932.453378:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453379:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453382:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036608 00000004:00200000:3.0:1705683932.453385:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000404:0x40bb:0x0]: returning size 4096 00010000:00010000:1.0:1705683932.453389:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5925 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.453399:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.453404:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.453404:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.453405:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.453407:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.453408:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333024 00000100:00100000:1.0:1705683932.453410:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5925:1857:x1788538641036608:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.453410:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098af8000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.453412:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.453415:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.453415:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.453417:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5925 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.453420:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.453421:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009cee2600) 00010000:00010000:1.0:1705683932.453423:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5925 pid: 15105 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.453423:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.453424:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00000100:00100000:0.0:1705683932.453428:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453429:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.453429:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098af8000/0xefc4487a01878d64 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.453430:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d360280/0xefc4487a0185a3d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2f8eef expref: 5925 pid: 15105 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.453432:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036736 00010000:00010000:1.0:1705683932.453438:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.453439:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f102d00/0xefc4487a01807420 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22e3 expref: 3964 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.453439:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.453443:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.453445:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.453449:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5924:1857:x1788538641036608:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 38us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.453453:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333024 00010000:00010000:3.0:1705683932.453454:0:14222:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1705683932.453466:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453467:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453472:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036544 00000100:00100000:1.0:1705683932.453484:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453485:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453488:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413429 00000100:00100000:0.0:1705683932.453491:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.453491:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7306:x1788538641036544:12345-192.168.203.41@tcp:36:mrename.0 00000100:00100000:0.0:1705683932.453492:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453495:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333025 00000100:00100000:0.0:1705683932.453497:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:1857:x1788538641036736:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.453501:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.453503:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f102d00/0xefc4487a01807420 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22e3 expref: 3964 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.453509:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f102d00/0xefc4487a01807420 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22e3 expref: 3964 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.453509:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1705683932.453517:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b8a2580/0xefc4487a01877c07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41d5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c7f expref: 1800 pid: 14233 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1705683932.453526:0:14222:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x19d:0x0] 00010000:00010000:1.0:1705683932.453528:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41d5:0x0].0x0 (ffff8800a1256d00) 00010000:00010000:3.0:1705683932.453532:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.453535:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453536:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afad00/0xefc4487a01878d17 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011f7 expref: 1799 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.453537:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453543:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff8801353cbc00) 00010000:00010000:3.0:1705683932.453543:0:14222:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1705683932.453544:0:14222:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0x19d:0x0] 00010000:00010000:3.0:1705683932.453546:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878d48 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453547:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.453548:0:14222:0:(ldlm_lock.c:910:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800a15cc280/0xefc4487a01878d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878d48 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453564:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f102d00/0xefc4487a01807420 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d22e3 expref: 3964 pid: 15140 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.453570:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.453571:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.453572:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453575:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.453582:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1923:7185:x1788538641034304:12345-192.168.203.41@tcp:36:rm.0 Request processed in 6545us (6675us total) trans 4295091442 rc 0/0 00010000:00010000:0.0:1705683932.453584:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.453586:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413424 00000100:00100000:0.0:1705683932.453599:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:1857:x1788538641036736:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.453602:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333025 00010000:00010000:1.0:1705683932.453609:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.453614:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1705683932.453616:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453617:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453621:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453622:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098af9400 already unused, calling callback (ffffffffa0d76510) 00010000:00010000:0.0:1705683932.453624:0:8828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1705683932.453628:0:8828:0:(mdt_handler.c:3677:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453642:0:8828:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453645:0:8828:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1705683932.453653:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453657:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880098af9400/0xefc4487a01878d56 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878d5d expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453668:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1705683932.453669:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453672:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801332b8780 already unused, calling callback (ffffffffa0d76510) 00010000:00010000:0.0:1705683932.453673:0:8828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1705683932.453675:0:8828:0:(mdt_handler.c:3677:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453677:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:1.0:1705683932.453682:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453684:0:8828:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453687:0:8828:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1705683932.453687:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453689:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453691:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801332b8780/0xefc4487a01878cc3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878cd8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453748:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.453749:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.453750:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.453758:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3083:1788538584518848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.453775:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000100:00100000:0.0:1705683932.453777:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1705683932.453780:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453785:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.453788:0:3083:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1705683932.453792:0:3083:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3083:1788538584518912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.453801:0:3083:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1705683932.453810:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453811:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453815:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518848 00000100:00100000:0.0:1705683932.453826:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453826:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453828:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584518912 00000100:00100000:0.0:1705683932.453835:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453836:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453839:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73800 00000100:00100000:0.0:1705683932.453841:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0000-mdtlov_UUID+44:3083:x1788538584518848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.453846:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.453851:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009b27b200/0xefc4487a01878d5d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x40bb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xefc4487a01878d56 expref: 44 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.453853:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.453858:0:15238:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x40bb:0x0].0x0 (ffff88009a7d0a00) 00010000:00010000:1.0:1705683932.453858:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453861:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.453862:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.453873:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0000-mdtlov_UUID+43:3083:x1788538584518848:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.453877:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73800 00000100:00100000:0.0:1705683932.453892:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.453893:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.453894:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000100:00100000:0.0:1705683932.453895:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73801 00000100:00100000:0.0:1705683932.453897:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0000-mdtlov_UUID+42:3083:x1788538584518912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.453898:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453903:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.453903:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.453909:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15cdb80/0xefc4487a01878cd8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xefc4487a01878cc3 expref: 42 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.453916:0:15238:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x0 (ffff88012b17cc00) 00010000:00010000:0.0:1705683932.453920:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.453932:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0000-mdtlov_UUID+41:3083:x1788538584518912:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.453935:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73801 00010000:00010000:1.0:1705683932.453943:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453947:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453951:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.453952:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3083:1788538584518912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.453953:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098afa300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.453955:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.453957:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3083:1788538584518848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.453958:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453962:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41d5:0x0].0x0 (ffff880081a9e700) 00010000:00010000:1.0:1705683932.453964:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1705683932.453965:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453968:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afa300/0xefc4487a01878d8e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453977:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453981:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453984:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453987:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098afbc00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.453988:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453991:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.453995:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff880081a9e100) 00010000:00010000:1.0:1705683932.453996:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1705683932.453997:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.453997:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454000:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afbc00/0xefc4487a01878d87 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41ef:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454010:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454013:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454016:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.454019:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.454019:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098afb480 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.454020:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.454026:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.454026:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.454027:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454030:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036672 00010000:00010000:1.0:1705683932.454031:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff880081a9e800) 00010000:00010000:1.0:1705683932.454032:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.454033:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454036:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afb480/0xefc4487a01878d80 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.454037:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3963 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.454043:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454045:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.454047:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454048:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.454048:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000100:00100000:0.0:1705683932.454051:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333026 00000100:00100000:0.0:1705683932.454052:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:1857:x1788538641036672:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.454052:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454054:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098afaa80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.454056:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.454056:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.454059:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3963 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.454059:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.454061:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.454062:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.454063:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:1.0:1705683932.454064:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.454065:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454068:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098afaa80/0xefc4487a01878d72 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.454068:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037120 00010000:00010000:0.0:1705683932.454069:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3963 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.454074:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454092:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.454096:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.454096:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.454097:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.454099:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098af8280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.454100:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.454101:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413430 00010000:00010000:1.0:1705683932.454103:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.454104:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1899:7349:x1788538641037120:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1705683932.454107:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880081a9ec00) 00010000:00010000:1.0:1705683932.454109:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.454110:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073546800/0xefc4487a01807497 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x8701:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d2353 expref: 3963 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.454110:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.454112:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.454113:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098af8280/0xefc4487a01878d79 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.454117:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.454118:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.454119:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454132:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 4/0,1 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.454141:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1798:7306:x1788538641036544:12345-192.168.203.41@tcp:36:mrename.0 Request processed in 648us (825us total) trans 0 rc -39/-39 00000100:00100000:1.0:1705683932.454146:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413429 00010000:00010000:0.0:1705683932.454154:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.454160:0:6521:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1705683932.454172:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3962:1857:x1788538641036672:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 112us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.454176:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333026 00010000:00010000:1.0:1705683932.454180:0:15110:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454186:0:15110:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454188:0:15133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454191:0:15110:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454192:0:15133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454195:0:15133:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454196:0:15110:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454197:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9b200/0xefc4487a01878d95 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30124b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454200:0:15133:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454205:0:15110:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1705683932.454208:0:15133:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1705683932.454272:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:3.0:1705683932.454279:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454283:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.454299:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.454334:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f3cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:lustre-MDT0001-mdtlov_UUID+3333:3083:x1788538584516608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8381us (8399us total) trans 4295348339 rc 0/0 00000100:00100000:1.0:1705683932.454339:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920858 00000100:00100000:0.0:1705683932.454344:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f38500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:lustre-MDT0001-mdtlov_UUID+3333:3081:x1788538584517952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5106us (5202us total) trans 4295348340 rc 0/0 00000100:00100000:0.0:1705683932.454348:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920869 00000100:00100000:0.0:1705683932.454356:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.454356:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:0.0:1705683932.454357:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.454358:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.454359:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036800 00010000:00010000:3.0:1705683932.454361:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.454366:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.454374:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454375:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454377:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333027 00000100:00100000:0.0:1705683932.454379:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3536:1857:x1788538641036800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.454382:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.454384:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.454387:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.454397:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131fd8280/0xefc4487a017f514c lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca5f4 expref: 3536 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.454405:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.454406:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:3.0:1705683932.454407:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4091:0x0]: returning size 4096 00010000:00010000:0.0:1705683932.454408:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011fe expref: 3460 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454412:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011fe expref: 3460 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454436:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1705683932.454438:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454438:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454441:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454443:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1059900 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.454443:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454445:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454446:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454447:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb99180 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.454448:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454449:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454451:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454454:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.454455:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.454456:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454457:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454458:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb99180/0xefc4487a01878d9c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.454463:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b279b80/0xefc4487a01878d1e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3011fe expref: 3460 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454466:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1059900/0xefc4487a01878ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x86fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.454468:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6518:1788538584518976:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.454468:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454470:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.454474:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454477:0:11072:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.454477:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009cb9af80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.454477:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454479:0:11072:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454479:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.454481:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.454481:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88008188ea00) 00010000:00010000:3.0:1705683932.454482:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.454483:0:11072:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801332ba800 already unused, calling callback (ffffffffa0664e00) 00010000:00010000:3.0:1705683932.454483:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454484:0:11072:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454484:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9af80/0xefc4487a01878da3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.454489:0:11072:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454495:0:11072:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454499:0:11072:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332ba800/0xefc4487a01878cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.454500:0:3081:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131f38000/2, rc 0, transno 381044 00000100:00100000:0.0:1705683932.454503:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584517952:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1705683932.454508:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9b200/0xefc4487a01878d95 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30124b expref: 1901 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454509:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.454510:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1705683932.454511:0:11072:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.454511:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9b200/0xefc4487a01878d95 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30124b expref: 1901 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.454518:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb9b200, rc 0) 00000100:00100000:0.0:1705683932.454522:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000004:00080000:1.0:1705683932.454525:0:3083:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131f39e00/2, rc 0, transno 381043 00000100:00100000:1.0:1705683932.454528:0:3083:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131f39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3083:1788538584516608:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1705683932.454533:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1900:7349:x1788538641037120:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 429us (536us total) trans 4295084974 rc 301/301 00000100:00100000:1.0:1705683932.454535:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454536:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.454536:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.454536:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413430 00000100:00100000:1.0:1705683932.454541:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036864 00000100:00100000:0.0:1705683932.454542:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454543:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454546:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036928 00010000:00010000:3.0:1705683932.454548:0:15119:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1705683932.454554:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.454554:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454555:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454555:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.454558:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920877 00000100:00100000:0.0:1705683932.454562:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920878 00000100:00100000:1.0:1705683932.454562:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:4708:x1788538641036864:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.454565:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:7259:x1788538641036928:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.454568:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.454571:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.454611:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30122f expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454622:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3460 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.454626:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.454627:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.454628:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30122f expref: 3538 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454640:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3460 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.454647:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3460 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.454653:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584519040:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.454667:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.454778:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b279900/0xefc4487a01878db8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301236 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.454786:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.454793:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.454794:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.454796:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b279900/0xefc4487a01878db8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301236 expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454803:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b279900/0xefc4487a01878db8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301236 expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.454807:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b279900, rc 0) 00000100:00100000:0.0:1705683932.454817:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3539:7259:x1788538641036928:12345-192.168.203.41@tcp:101:dd.0 Request processed in 251us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.454820:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920878 00000100:00100000:0.0:1705683932.454838:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.454858:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.454862:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454863:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454866:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641036992 00000100:00100000:0.0:1705683932.454873:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454874:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.454874:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.454875:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454876:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037056 00000100:00100000:0.0:1705683932.454881:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.454882:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.454882:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920879 00000100:00100000:0.0:1705683932.454885:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920880 00000100:00100000:1.0:1705683932.454886:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:6554:x1788538641036992:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.454888:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:6496:x1788538641037056:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.454891:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.454892:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.454923:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30123d expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454935:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3964 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.454939:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.454941:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.454942:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30123d expref: 3964 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.454954:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3964 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.454959:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3964 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.454966:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc18500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584519104:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.454978:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.455109:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.455118:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455119:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455123:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037184 00000100:00100000:1.0:1705683932.455134:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455135:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455138:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920881 00000100:00100000:1.0:1705683932.455142:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3461:1854:x1788538641037184:12345-192.168.203.41@tcp:2:touch.0 00010000:00010000:0.0:1705683932.455145:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b278500/0xefc4487a01878dc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301244 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.455158:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.455165:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.455166:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.455169:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b278500/0xefc4487a01878dc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301244 expref: 3965 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455174:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b278500/0xefc4487a01878dc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301244 expref: 3965 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455177:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b278500, rc 0) 00000100:00100000:0.0:1705683932.455186:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:6496:x1788538641037056:12345-192.168.203.41@tcp:101:dd.0 Request processed in 297us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.455190:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920880 00000100:00100000:0.0:1705683932.455211:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.455219:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455220:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455226:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037312 00000100:00100000:0.0:1705683932.455233:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455234:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455237:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107558 00000100:00100000:0.0:1705683932.455240:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1900:7345:x1788538641037312:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:0.0:1705683932.455330:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1901:7345:x1788538641037312:12345-192.168.203.41@tcp:35:touch.0 Request processed in 89us (119us total) trans 4295084975 rc 0/0 00000100:00100000:0.0:1705683932.455333:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107558 00000100:00100000:0.0:1705683932.455353:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.455358:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455359:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455361:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037376 00000100:00100000:0.0:1705683932.455368:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455368:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455370:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920882 00000100:00100000:0.0:1705683932.455373:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5924:16415:x1788538641037376:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.455378:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.455404:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3462:1854:x1788538641037184:12345-192.168.203.41@tcp:2:touch.0 Request processed in 260us (294us total) trans 4295340570 rc 0/0 00000100:00100000:1.0:1705683932.455409:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920881 00010000:00010000:0.0:1705683932.455457:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301252 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455466:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3964 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455470:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.455471:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.455473:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301252 expref: 5925 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455484:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3964 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455488:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3964 pid: 15135 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.455492:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133210f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584519168:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.455499:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.455503:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.455511:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455511:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455511:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455511:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455515:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037440 00000100:00100000:0.0:1705683932.455532:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455532:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455533:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.455533:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.455535:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920883 00000100:00100000:0.0:1705683932.455537:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:6521:x1788538641037440:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.455541:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.455800:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b27a080/0xefc4487a01878dd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301259 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.455808:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.455814:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.455814:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.455816:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b27a080/0xefc4487a01878dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301259 expref: 5927 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455820:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b27a080/0xefc4487a01878dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301259 expref: 5927 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.455824:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b27a080, rc 0) 00000100:00100000:0.0:1705683932.455844:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5927:6521:x1788538641037440:12345-192.168.203.41@tcp:101:dd.0 Request processed in 305us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.455848:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920883 00000100:00100000:0.0:1705683932.456492:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133210f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584519168:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.456500:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6518:1788538584518976:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.456501:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301252 expref: 5926 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.456506:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b27a300, rc 0) 00010000:00010000:1.0:1705683932.456510:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.456527:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3538:1857:x1788538641036800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2147us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.456532:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333027 00000100:00100000:1.0:1705683932.456550:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc18500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584519104:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.456560:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30123d expref: 3964 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.456561:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:16415:x1788538641037376:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1187us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.456565:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920882 00010000:00010000:1.0:1705683932.456567:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf2300, rc 0) 00000100:00100000:1.0:1705683932.456581:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:6554:x1788538641036992:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1695us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.456585:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920879 00000100:00100000:0.0:1705683932.456587:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.456593:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456593:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456594:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456594:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456597:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037568 00000100:00100000:1.0:1705683932.456611:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456612:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456613:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456614:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456615:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920884 00000100:00100000:1.0:1705683932.456618:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:7259:x1788538641037568:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.456624:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.456630:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.456658:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.456666:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456667:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456671:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037504 00010000:00010000:0.0:1705683932.456679:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3462 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.456686:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456687:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456689:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037696 00010000:00010000:0.0:1705683932.456694:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3965 pid: 15135 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.456700:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456700:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456702:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333028 00000100:00100000:0.0:1705683932.456704:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3462:1855:x1788538641037504:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.456722:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.456732:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3462 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.456738:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3462 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.456746:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.456747:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.456748:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30122f expref: 3537 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.456753:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30122f expref: 3537 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.456766:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30122f expref: 3537 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.456771:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584519232:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.456783:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.456790:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456791:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.456801:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf1400/0xefc4487a01878ddb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9643:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301260 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.456811:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9643:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.456819:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.456820:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.456823:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf1400/0xefc4487a01878ddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301260 expref: 3966 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.456830:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf1400/0xefc4487a01878ddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301260 expref: 3966 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.456835:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf1400, rc 0) 00000100:00100000:0.0:1705683932.456843:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333029 00000100:00100000:0.0:1705683932.456846:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:1855:x1788538641037696:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.456849:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:7259:x1788538641037568:12345-192.168.203.41@tcp:101:dd.0 Request processed in 231us (262us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.456850:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.456852:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3966 pid: 15135 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.456854:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920884 00010000:00010000:0.0:1705683932.456856:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3966 pid: 15135 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.456864:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a583700/0xefc4487a0181eb25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9973 expref: 3965 pid: 15135 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.456872:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.456873:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.456873:0:15110:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ae080/0xefc4487a01847a54 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca1 expref: 3462 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.456874:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301252 expref: 5925 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.456877:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301252 expref: 5925 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.456882:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584519040:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.456886:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b27a300/0xefc4487a01878dcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301252 expref: 5925 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.456890:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584519296:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.456892:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2080/0xefc4487a01878db1 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30122f expref: 3537 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.456897:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf2080, rc 0) 00000100:00100000:0.0:1705683932.456902:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.456908:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:4708:x1788538641036864:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2346us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.456911:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920877 00000100:00100000:0.0:1705683932.456946:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.456952:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456952:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.456955:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037632 00010000:00010000:0.0:1705683932.456963:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3965 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.456978:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456979:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.456985:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333030 00000100:00100000:1.0:1705683932.456989:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:1855:x1788538641037632:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.456995:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.457003:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3965 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.457009:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3965 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.457019:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8280/0xefc4487a0186357d lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x951d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1ef expref: 3965 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.457026:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.457027:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.457029:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30123d expref: 3964 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457033:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30123d expref: 3964 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457045:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf2300/0xefc4487a01878dbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30123d expref: 3964 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.457056:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584519360:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.457092:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.457107:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.457116:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457117:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457122:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037824 00000100:00100000:1.0:1705683932.457125:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.457132:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457133:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457136:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457136:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457137:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037888 00000100:00100000:0.0:1705683932.457139:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107559 00000100:00100000:0.0:1705683932.457141:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc18500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1798:7185:x1788538641037824:12345-192.168.203.41@tcp:35:rm.0 00000100:00100000:1.0:1705683932.457148:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457148:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457151:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920885 00000100:00100000:1.0:1705683932.457154:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3537:6496:x1788538641037888:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.457160:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:0.0:1705683932.457239:0:14361:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0xa8:0x0].1037, 344 off838624 00000040:00080000:0.0:1705683932.457263:0:14361:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x7a:0x0].242, 456 off237112 00000004:00080000:0.0:1705683932.457266:0:14361:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009c20a6c0 with version 15696 00010000:00010000:1.0:1705683932.457319:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf0500/0xefc4487a01878de2 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x838d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301267 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1705683932.457324:0:7681:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a94a6600 version 15696 rpc_version 15696 00002000:00010000:1.0:1705683932.457329:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x838d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:00100000:0.0:1705683932.457335:0:7681:0:(genops.c:2249:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1705683932.457336:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.457337:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.457338:0:7681:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880097efc600 x1788538584519488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1705683932.457339:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf0500/0xefc4487a01878de2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301267 expref: 3538 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457346:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf0500/0xefc4487a01878de2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301267 expref: 3538 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.457348:0:7681:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7681:1788538584519488:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1705683932.457352:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf0500, rc 0) 00000100:00100000:0.0:1705683932.457368:0:7681:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1705683932.457369:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3538:6496:x1788538641037888:12345-192.168.203.41@tcp:101:dd.0 Request processed in 214us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.457374:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920885 00000100:00100000:0.0:1705683932.457385:0:7681:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.457408:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.457411:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.457420:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584519488 00000100:00100000:1.0:1705683932.457424:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.457436:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457437:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457438:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.457441:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641037952 00000100:00100000:1.0:1705683932.457443:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457444:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.457448:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457449:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038016 00000100:00100000:3.0:1705683932.457449:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457452:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457453:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.457454:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59902 00000100:00100000:0.0:1705683932.457457:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920886 00000100:00100000:3.0:1705683932.457459:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+39:7681:x1788538584519488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1705683932.457460:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3462:6521:x1788538641037952:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.457462:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457463:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.457465:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.457466:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413431 00000100:00100000:1.0:1705683932.457469:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7312:x1788538641038016:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:1.0:1705683932.457475:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.457546:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf2800/0xefc4487a01878de9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301275 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.457599:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eff300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+40:7681:x1788538584519488:12345-0@lo:1000:osp_up0-1.0 Request processed in 140us (230us total) trans 4295091443 rc 0/0 00000100:00100000:3.0:1705683932.457603:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59902 00010000:00010000:1.0:1705683932.457613:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.457620:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457625:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457685:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.457689:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457692:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457737:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.457743:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457748:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.457752:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b278280/0xefc4487a01878dfe lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30126e expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1705683932.457763:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x419f:0x0]: returning size 4096 00002000:00010000:0.0:1705683932.457764:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00200000:1.0:1705683932.457765:0:8825:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1705683932.457772:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.457773:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:1.0:1705683932.457775:0:8825:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.457776:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b278280/0xefc4487a01878dfe lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30126e expref: 3463 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457781:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.457783:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b278280/0xefc4487a01878dfe lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30126e expref: 3463 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457785:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.457788:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b278280, rc 0) 00010000:00010000:1.0:1705683932.457788:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457791:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457795:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a6cf0780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.457797:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457801:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.457806:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3463:6521:x1788538641037952:12345-192.168.203.41@tcp:101:dd.0 Request processed in 346us (382us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.457806:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:1.0:1705683932.457808:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.457809:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.457810:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920886 00010000:00010000:1.0:1705683932.457813:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0780/0xefc4487a01878df0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457822:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457825:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457829:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457832:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a6cf0a00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.457833:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457836:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457840:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff880081a9ea00) 00000100:00100000:0.0:1705683932.457842:0:7681:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efc600 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7681:1788538584519488:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1705683932.457842:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.457843:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457846:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0a00/0xefc4487a01878df7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.457868:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf2800/0xefc4487a01878de9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301275 expref: 1802 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.457875:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301275 expref: 1801 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.457878:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc18500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1801:7185:x1788538641037824:12345-192.168.203.41@tcp:35:rm.0 Request processed in 735us (770us total) trans 4295084976 rc 0/0 00010000:00010000:1.0:1705683932.457879:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:1.0:1705683932.457880:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1705683932.457881:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf1180, rc 0) 00000100:00100000:0.0:1705683932.457883:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107559 00000100:00100000:1.0:1705683932.457894:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7312:x1788538641038016:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 425us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.457898:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413431 00000100:00100000:0.0:1705683932.457909:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.457916:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457916:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457919:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038144 00000100:00100000:0.0:1705683932.457927:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.457928:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457928:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.457931:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107560 00000100:00100000:0.0:1705683932.457932:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1901:7346:x1788538641038144:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:1.0:1705683932.457935:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457936:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457939:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038272 00000100:00100000:1.0:1705683932.457958:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457959:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.457962:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413432 00000100:00100000:1.0:1705683932.457965:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc19900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1902:7352:x1788538641038272:12345-192.168.203.41@tcp:36:mkdir.0 00000100:00100000:0.0:1705683932.458000:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1903:7346:x1788538641038144:12345-192.168.203.41@tcp:35:touch.0 Request processed in 65us (91us total) trans 4295084977 rc 0/0 00000100:00100000:0.0:1705683932.458003:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107560 00000100:00100000:1.0:1705683932.458014:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc19900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1902:7352:x1788538641038272:12345-192.168.203.41@tcp:36:mkdir.0 Request processed in 47us (85us total) trans 0 rc -17/-17 00000100:00100000:1.0:1705683932.458018:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413432 00000100:00100000:0.0:1705683932.458031:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584519232:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.458039:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.458050:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3462:1855:x1788538641037504:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1345us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.458054:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333028 00000100:00100000:0.0:1705683932.458089:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584519296:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.458096:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.458106:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3964:1855:x1788538641037696:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1260us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.458110:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333029 00000100:00100000:1.0:1705683932.458127:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.458137:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458138:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458142:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038336 00000100:00100000:0.0:1705683932.458152:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458153:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458155:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920887 00000100:00100000:0.0:1705683932.458158:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5926:16443:x1788538641038336:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.458164:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.458201:0:6522:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.458368:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30127c expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458380:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3963 pid: 15098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458385:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.458385:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.458387:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30127c expref: 5927 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.458394:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.458398:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3963 pid: 15098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458404:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3963 pid: 15098 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.458412:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584519552:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.458416:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1c600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584519360:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.458427:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.458431:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.458438:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:1855:x1788538641037632:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1449us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.458439:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458440:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458443:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038400 00000100:00100000:1.0:1705683932.458443:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333030 00000100:00100000:0.0:1705683932.458454:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458465:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.458473:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458474:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458479:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038464 00000100:00100000:1.0:1705683932.458487:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458488:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458491:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920888 00000100:00100000:1.0:1705683932.458493:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3462:16415:x1788538641038400:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.458499:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.458555:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458560:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920889 00000100:00100000:0.0:1705683932.458564:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3538:6554:x1788538641038464:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.458570:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.458664:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301283 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.458675:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3538 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458679:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30128a expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.458680:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.458681:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.458682:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301283 expref: 3463 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458692:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3539 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.458692:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3539 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.458697:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.458697:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3539 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.458698:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.458699:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30128a expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.458703:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584519616:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.458723:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3539 pid: 15225 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.458728:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009ae0c0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.458729:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3539 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.458741:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584519680:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.458757:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.458765:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458766:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.458766:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458769:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038528 00000100:00100000:0.0:1705683932.458777:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458777:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458778:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458778:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458780:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920890 00000100:00100000:1.0:1705683932.458783:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3963:4708:x1788538641038528:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.458788:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.458800:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.458840:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301298 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.458849:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5927 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.458854:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.458854:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.458856:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301298 expref: 3964 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.458865:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5927 pid: 15104 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.458869:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5927 pid: 15104 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.458870:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458871:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458875:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038592 00000100:00100000:1.0:1705683932.458875:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1e900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584519744:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.458886:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.458887:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458889:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.458890:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920891 00000100:00100000:0.0:1705683932.458893:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:6496:x1788538641038592:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.458899:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.458921:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.458929:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458930:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458934:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038656 00000100:00100000:1.0:1705683932.458945:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458946:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.458949:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920892 00000100:00100000:1.0:1705683932.458952:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:7259:x1788538641038656:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.458957:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.459159:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2580/0xefc4487a01878e28 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30129f expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.459168:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.459176:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.459177:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.459179:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2580/0xefc4487a01878e28 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30129f expref: 3541 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.459186:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf2580/0xefc4487a01878e28 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30129f expref: 3541 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.459191:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf2580, rc 0) 00000100:00100000:1.0:1705683932.459205:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:7259:x1788538641038656:12345-192.168.203.41@tcp:101:dd.0 Request processed in 253us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.459210:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920892 00000100:00100000:1.0:1705683932.459250:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.459259:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459260:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459264:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038784 00000100:00100000:1.0:1705683932.459282:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459283:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459287:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413433 00000100:00100000:1.0:1705683932.459290:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7185:x1788538641038784:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:0.0:1705683932.459300:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b30780/0xefc4487a01878e2f lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301291 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.459307:0:8825:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1705683932.459309:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.459315:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.459316:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.459316:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1652d00/0xefc4487a01877ae8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x40c9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c40 expref: 1800 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459318:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b30780/0xefc4487a01878e2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301291 expref: 3966 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459322:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b30780/0xefc4487a01878e2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301291 expref: 3966 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459327:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b30780, rc 0) 00010000:00010000:1.0:1705683932.459328:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099fcf980/0xefc4487a018769d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x40c9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30070e expref: 1799 pid: 14257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.459341:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:6496:x1788538641038592:12345-192.168.203.41@tcp:101:dd.0 Request processed in 447us (541us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.459344:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x40c9:0x0].0x0 (ffff88008b32f400) 00000100:00100000:0.0:1705683932.459345:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920891 00010000:00010000:1.0:1705683932.459348:0:8825:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.459370:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.459415:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00000100:00100000:0.0:1705683932.459420:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.459420:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.459421:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.459424:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.459425:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038848 00010000:00010000:1.0:1705683932.459463:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0000/0xefc4487a01878e3d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42cb:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.459467:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0000/0xefc4487a01878e3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42cb:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459470:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0000/0xefc4487a01878e3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42cb:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.459473:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459473:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459477:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920893 00000100:00100000:0.0:1705683932.459479:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5928:6521:x1788538641038848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.459483:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.459513:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.459517:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459521:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459594:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,1 mode: --/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.459598:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459602:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459617:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8825 initiator: MDT0 00010000:00010000:1.0:1705683932.459620:0:8825:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.459625:0:8825:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.459634:0:8825:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc1c100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8825:1788538584519808:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1705683932.459637:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b32800/0xefc4487a01878e59 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012a6 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.459645:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.459650:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.459650:0:8825:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1705683932.459651:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.459653:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b32800/0xefc4487a01878e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012a6 expref: 5929 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459658:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b32800/0xefc4487a01878e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012a6 expref: 5929 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459661:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b32800, rc 0) 00000100:00100000:1.0:1705683932.459661:0:8825:0:(client.c:2536:ptlrpc_set_wait()) set ffff880134ede0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.459671:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:6521:x1788538641038848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 192us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.459672:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459674:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920893 00000100:00100000:3.0:1705683932.459674:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459681:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584519808 00000100:00100000:1.0:1705683932.459694:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.459700:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459701:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459705:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59903 00000100:00100000:3.0:1705683932.459718:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+40:8825:x1788538584519808:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1705683932.459732:0:14256:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.459745:0:14256:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xefc4487a01878e52 expref: -99 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.459756:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097ef8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584519552:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.459764:0:14256:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1922 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.459766:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30127c expref: 5928 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.459768:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.459771:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b27aa80, rc 0) 00010000:00010000:3.0:1705683932.459771:0:14256:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.459776:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459777:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459781:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5928:16443:x1788538641038336:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1623us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.459781:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039040 00000100:00100000:0.0:1705683932.459784:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920887 00010000:00010000:1.0:1705683932.459792:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3966 pid: 15098 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.459797:0:14256:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1922 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.459805:0:14256:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1922 pid: 14222 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.459814:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459815:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459818:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333031 00000100:00100000:1.0:1705683932.459821:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4292850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:1856:x1788538641039040:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.459821:0:14256:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:14256:1788538584519872:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.459826:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.459828:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3966 pid: 15098 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.459832:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.459833:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3966 pid: 15098 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.459843:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801357b4f00/0xefc4487a017f540f lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ca760 expref: 3966 pid: 15098 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.459849:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.459850:0:6518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.459851:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30127c expref: 5927 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.459855:0:14256:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.459856:0:6518:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30127c expref: 5927 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.459868:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b27aa80/0xefc4487a01878e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30127c expref: 5927 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.459871:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459872:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.459876:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bc19400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584519936:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.459879:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038912 00000100:00100000:1.0:1705683932.459892:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.459897:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459898:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459900:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641038976 00000100:00100000:0.0:1705683932.459901:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459902:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.459906:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413434 00000100:00100000:0.0:1705683932.459909:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1a800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1799:7318:x1788538641038912:12345-192.168.203.41@tcp:101:mrename.0 00000100:00100000:3.0:1705683932.459913:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.459914:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.459916:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.459918:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413435 00000100:00100000:3.0:1705683932.459922:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ef8500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1902:7353:x1788538641038976:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.459930:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.459956:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32580/0xefc4487a01878e67 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.460046:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9aa80/0xefc4487a01878e6e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012b4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.460085:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.460092:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460097:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.460148:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.460157:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460158:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.460163:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.460164:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460171:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460216:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.460222:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460226:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:0.0:1705683932.460241:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41a5:0x0]: returning size 4096 00000004:00200000:0.0:1705683932.460243:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1705683932.460249:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460253:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460255:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460257:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460259:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460261:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131b32080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.460262:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460265:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460270:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.460272:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.460273:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460276:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32080/0xefc4487a01878e75 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.460278:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.460282:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460283:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460285:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.460288:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460341:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460345:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131b30a00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.460346:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460348:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460352:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88009d374f00) 00010000:00010000:0.0:1705683932.460353:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.460354:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.460356:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30a00/0xefc4487a01878e83 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.460394:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584519616:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.460408:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301283 expref: 3463 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.460415:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf3480, rc 0) 00010000:00010000:0.0:1705683932.460418:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32580/0xefc4487a01878e67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ad expref: 1801 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.460420:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7480/0xefc4487a01878e98 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.460426:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7480/0xefc4487a01878e98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460427:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ad expref: 1800 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.460430:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff88009d374b00) 00010000:00010000:0.0:1705683932.460431:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1705683932.460431:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3463:16415:x1788538641038400:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1936us (2038us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.460431:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7480/0xefc4487a01878e98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460432:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b30280, rc 0) 00000100:00100000:1.0:1705683932.460435:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920888 00000100:00100000:0.0:1705683932.460442:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1a800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7318:x1788538641038912:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 533us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.460445:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413434 00000004:00200000:3.0:1705683932.460455:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x422f:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.460458:0:14377:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.460467:0:14377:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7480/0xefc4487a01878e98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460472:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460475:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460478:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460483:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460486:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e4000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.460488:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460493:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.460500:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880097efcb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584519680:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.460502:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.460504:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.460506:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460508:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30128a expref: 3540 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.460509:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4000/0xefc4487a01878e7c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.460514:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b27b700, rc 0) 00010000:00010000:3.0:1705683932.460520:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.460524:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:6554:x1788538641038464:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1960us (2059us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.460524:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460527:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.460528:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920889 00010000:00010000:3.0:1705683932.460531:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e7c00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.460532:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460536:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460540:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff88008188e200) 00010000:00010000:3.0:1705683932.460542:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.460543:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460547:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7c00/0xefc4487a01878e91 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.460575:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb9aa80/0xefc4487a01878e6e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012b4 expref: 1904 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.460587:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7480/0xefc4487a01878e98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012b4 expref: 1903 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.460590:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.460591:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1705683932.460592:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d2e7480, rc 0) 00000100:00100000:3.0:1705683932.460619:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ef8500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1903:7353:x1788538641038976:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 697us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.460623:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413435 00000100:00100000:0.0:1705683932.460730:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.460735:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1e900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584519744:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.460738:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460739:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460743:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039104 00010000:00010000:1.0:1705683932.460748:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301298 expref: 3965 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.460752:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3540 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.460755:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf0280, rc 0) 00000100:00100000:0.0:1705683932.460762:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460763:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460766:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333032 00000100:00100000:0.0:1705683932.460768:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:1854:x1788538641039104:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.460772:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:4708:x1788538641038528:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1987us (2015us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.460773:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.460776:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3540 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.460777:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920890 00010000:00010000:0.0:1705683932.460782:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3540 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.460793:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131ebd400/0xefc4487a0181edbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9a45 expref: 3540 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.460801:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.460801:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.460802:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.460804:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301283 expref: 3462 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.460809:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301283 expref: 3462 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.460843:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.460857:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.460863:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.460863:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.460868:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039296 00000100:00100000:1.0:1705683932.460878:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.460879:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.460882:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920894 00000100:00100000:1.0:1705683932.460885:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:7259:x1788538641039296:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.460890:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.460933:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf3480/0xefc4487a01878e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301283 expref: 3462 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.460939:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584520000:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.460955:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.460962:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460963:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460967:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039232 00010000:00010000:0.0:1705683932.460975:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5928 pid: 15104 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.460990:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460991:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.460994:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039168 00010000:00010000:0.0:1705683932.460999:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3540 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.461006:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461006:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461008:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333033 00000100:00100000:0.0:1705683932.461011:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5928:1854:x1788538641039232:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.461017:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.461024:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5928 pid: 15104 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.461087:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461088:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461093:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333034 00000100:00100000:1.0:1705683932.461096:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:1854:x1788538641039168:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.461101:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.461108:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3540 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.461113:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3540 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.461123:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5928 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.461124:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801332a2080/0xefc4487a0186358b lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1f6 expref: 3540 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.461131:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461132:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461133:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30128a expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.461134:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8acf00/0xefc4487a01847a62 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecca8 expref: 5928 pid: 15104 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.461138:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30128a expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.461143:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.461144:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.461146:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301298 expref: 3965 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461152:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b27b700/0xefc4487a01878e1a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30128a expref: 3539 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.461156:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301298 expref: 3965 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461158:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b21900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584520064:192.168.203.41@tcp:105: 00000004:00080000:3.0:1705683932.461166:0:3082:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131dc1900/2, rc 0, transno 380952 00010000:00010000:0.0:1705683932.461171:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf0280/0xefc4487a01878e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301298 expref: 3965 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461172:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.461172:0:3082:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880131dc1900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3082:1788538584504064:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1705683932.461176:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315db700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584520128:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.461186:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999bf480/0xefc4487a01878e9f lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9644:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012bb expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.461196:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9644:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.461201:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.461203:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461204:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461206:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999bf480/0xefc4487a01878e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012bb expref: 3966 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461213:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999bf480/0xefc4487a01878e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012bb expref: 3966 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461218:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999bf480, rc 0) 00000100:00100000:1.0:1705683932.461230:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:7259:x1788538641039296:12345-192.168.203.41@tcp:101:dd.0 Request processed in 345us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.461234:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920894 00000100:00100000:3.0:1705683932.461302:0:14256:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:14256:1788538584519872:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.461313:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc19400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1788538584519936:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.461316:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.461319:0:14256:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461323:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.461325:0:14256:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x118:0x0].0x0 (ffff8800a0fc4400) 00010000:00010000:3.0:1705683932.461327:0:14256:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.461329:0:14256:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461334:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4292850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:1856:x1788538641039040:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1512us (1567us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.461334:0:14256:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 41 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.461339:0:14256:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb98f00, rc 0) 00000100:00100000:1.0:1705683932.461342:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333031 00000100:00100000:0.0:1705683932.461358:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.461371:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461372:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461376:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039360 00000100:00100000:3.0:1705683932.461377:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+41:8825:x1788538584519808:12345-0@lo:101:mdt00_003.0 Request processed in 1667us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.461385:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59903 00000100:00100000:1.0:1705683932.461387:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920895 00000100:00100000:0.0:1705683932.461389:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.461390:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:6496:x1788538641039360:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.461395:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461395:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.461395:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.461400:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039488 00000100:00100000:0.0:1705683932.461409:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461409:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461410:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039552 00000100:00100000:3.0:1705683932.461410:0:8825:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bc1c100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8825:1788538584519808:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1705683932.461414:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461414:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461417:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920896 00000100:00100000:0.0:1705683932.461418:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3464:16443:x1788538641039488:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.461419:0:8825:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.461423:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.461424:0:8825:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461551:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999bd180/0xefc4487a01878ea6 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x838e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012c2 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.461561:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x838e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.461568:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461569:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461571:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999bd180/0xefc4487a01878ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c2 expref: 3541 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461578:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999bd180/0xefc4487a01878ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c2 expref: 3541 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.461583:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999bd180, rc 0) 00010000:00010000:0.0:1705683932.461584:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012c9 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.461594:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3541 pid: 15097 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461599:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:6496:x1788538641039360:12345-192.168.203.41@tcp:101:dd.0 Request processed in 209us (284us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.461600:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.461600:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.461602:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c9 expref: 3465 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461604:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920895 00000100:00100000:1.0:1705683932.461611:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461612:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.461614:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3540 pid: 15097 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461615:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920897 00000100:00100000:1.0:1705683932.461617:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3465:6521:x1788538641039552:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.461619:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3540 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.461623:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584520192:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.461623:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.461637:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.461658:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.461679:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.461691:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.461692:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.461747:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999bcf00/0xefc4487a01878eb4 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012d0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.461751:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039616 00002000:00010000:1.0:1705683932.461756:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.461763:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.461764:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.461765:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.461765:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.461767:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999bcf00/0xefc4487a01878eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012d0 expref: 3466 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.461770:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413436 00010000:00010000:1.0:1705683932.461774:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999bcf00/0xefc4487a01878eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012d0 expref: 3466 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.461774:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1903:7353:x1788538641039616:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1705683932.461780:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999bcf00, rc 0) 00010000:00010000:3.0:1705683932.461781:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.461787:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7700/0xefc4487a01878ebb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012d7 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461794:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dd000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3466:6521:x1788538641039552:12345-192.168.203.41@tcp:101:dd.0 Request processed in 175us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.461798:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920897 00000100:00100000:1.0:1705683932.461810:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461811:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461815:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039424 00010000:00010000:1.0:1705683932.461824:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1923 pid: 14222 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.461831:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:0.0:1705683932.461836:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.461837:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461840:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:1.0:1705683932.461842:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461843:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.461846:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333035 00000100:00100000:1.0:1705683932.461849:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1923:1856:x1788538641039424:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.461854:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.461858:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1923 pid: 14222 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.461863:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1923 pid: 14222 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.461872:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131eb8500/0xefc4487a0187771b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x118:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300afe expref: 1923 pid: 14222 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.461881:0:6518:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x118:0x0].0x0 (ffff8800a0fc4400) 00010000:00010000:1.0:1705683932.461884:0:6518:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.461886:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.461889:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.461892:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461893:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.461894:0:6518:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.461896:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039872 00010000:00010000:1.0:1705683932.461907:0:6518:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 40 pid: 14256 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.461914:0:6518:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b26400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6518:1788538584520256:0@lo:105: 00000100:00100000:0.0:1705683932.461915:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461916:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461918:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039744 00000100:00100000:0.0:1705683932.461924:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461925:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.461928:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413437 00000100:00100000:0.0:1705683932.461931:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:7349:x1788538641039872:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.461932:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.461934:0:6518:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1705683932.461938:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.461942:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:1.0:1705683932.461944:0:6518:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345b40 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.461947:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461965:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.461969:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32300/0xefc4487a01878ed0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.461969:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461973:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461977:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461980:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e4c80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.461982:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461986:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.461993:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.461994:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.461996:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462000:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4c80/0xefc4487a01878ec2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462007:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462012:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462016:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462019:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e6580 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.462020:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462024:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.462029:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3231 (ffff88008188ed00) 00010000:00010000:3.0:1705683932.462031:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.462032:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.462034:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.462036:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6580/0xefc4487a01878ec9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.462039:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462042:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.462063:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7700/0xefc4487a01878ebb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012d7 expref: 1906 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.462069:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e7700/0xefc4487a01878ebb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012d7 expref: 1906 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.462075:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d2e7700, rc 0) 00010000:00010000:0.0:1705683932.462108:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00000100:00100000:1.0:1705683932.462110:0:14418:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462111:0:14418:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.462113:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462116:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.462118:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413438 00000100:00100000:3.0:1705683932.462120:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:7353:x1788538641039616:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 345us (439us total) trans 0 rc 301/301 00000100:00100000:1.0:1705683932.462122:0:14418:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7318:x1788538641039744:12345-192.168.203.41@tcp:36:mrename.0 00000100:00100000:3.0:1705683932.462124:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413436 00010000:00010000:1.0:1705683932.462143:0:14418:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1705683932.462150:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30280/0xefc4487a01878e8a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ad expref: 1800 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462160:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff88009d374b00) 00010000:00010000:1.0:1705683932.462167:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf1180/0xefc4487a01878e05 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301275 expref: 1799 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462174:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:1.0:1705683932.462176:0:14418:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1705683932.462206:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4091:0x0]: returning size 4096 00010000:00010000:1.0:1705683932.462212:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:1.0:1705683932.462217:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.462222:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.462270:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:1.0:1705683932.462275:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.462279:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.462290:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462294:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462297:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462299:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462303:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131b32a80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.462305:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462309:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.462313:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:0.0:1705683932.462314:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.462316:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.462317:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.462318:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462320:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32a80/0xefc4487a01878ed7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.462321:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.462325:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462327:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462329:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462332:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131b30000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.462333:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462337:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462342:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88009d374800) 00010000:00010000:1.0:1705683932.462354:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:1.0:1705683932.462359:0:14418:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1905 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462363:0:14418:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1905 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462366:0:14418:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 5/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.462379:0:14418:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1905 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462384:0:14418:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1905 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.462389:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b26900 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001_UUID:14418:1788538584520320:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.462409:0:14418:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1905 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462414:0:14418:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1905 pid: 14233 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.462418:0:14418:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001_UUID:14418:1788538584520384:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.462419:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.462422:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.462426:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b30000/0xefc4487a01878ede lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.462428:0:14418:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.462438:0:6517:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462439:0:6517:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462446:0:6517:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1705683932.462449:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32300/0xefc4487a01878ed0 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012de expref: 1905 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.462452:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b32300/0xefc4487a01878ed0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012de expref: 1905 pid: 6531 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.462452:0:6517:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584520256 00010000:00010000:0.0:1705683932.462457:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b32300, rc 0) 00000100:00100000:1.0:1705683932.462468:0:6517:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462469:0:6517:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.462470:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1904:7349:x1788538641039872:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 538us (687us total) trans 4295084978 rc 301/301 00000100:00100000:1.0:1705683932.462472:0:6517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15259 00000100:00100000:0.0:1705683932.462475:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413437 00000100:00100000:1.0:1705683932.462475:0:6517:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880123cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1788538584520256:12345-0@lo:105: 00010000:00010000:1.0:1705683932.462480:0:6517:0:(ldlm_lockd.c:2544:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462485:0:6517:0:(ldlm_lockd.c:2002:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462490:0:6517:0:(ldlm_lockd.c:2079:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462494:0:6517:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462499:0:6517:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462503:0:6517:0:(ldlm_lockd.c:2107:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462522:0:6517:0:(ldlm_lockd.c:2118:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800999bc280) 00010000:00010000:3.0:1705683932.462543:0:8825:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.462544:0:6517:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880123cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1788538584520256:12345-0@lo:105: Request processed in 68us (609us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.462549:0:8825:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.462551:0:6517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15259 00000100:00100000:1.0:1705683932.462602:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584520000:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.462613:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.462624:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880097efcb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:1854:x1788538641039104:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1855us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.462628:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333032 00000100:00100000:1.0:1705683932.462647:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b21900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584520064:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.462655:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.462664:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3539:1854:x1788538641039168:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1567us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.462668:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333034 00000100:00100000:1.0:1705683932.462682:0:6518:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b26400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6518:1788538584520256:0@lo:105: 00010000:00010000:1.0:1705683932.462689:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.462697:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1922:1856:x1788538641039424:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 848us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.462702:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333035 00000100:00100000:0.0:1705683932.462835:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.462842:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.462844:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315db700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584520128:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.462855:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.462857:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584520192:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.462865:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c9 expref: 3465 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.462870:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b31680, rc 0) 00000100:00100000:1.0:1705683932.462870:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc1e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5927:1854:x1788538641039232:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1857us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.462874:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333033 00000100:00100000:0.0:1705683932.462883:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3465:16443:x1788538641039488:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1463us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.462886:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.462887:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920896 00000100:00100000:1.0:1705683932.462887:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462890:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641039936 00000100:00100000:0.0:1705683932.462895:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.462896:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.462899:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040000 00000100:00100000:1.0:1705683932.462899:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462900:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.462903:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920898 00000100:00100000:1.0:1705683932.462906:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3965:6554:x1788538641039936:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.462909:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.462910:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.462912:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.462921:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920899 00000100:00100000:0.0:1705683932.462923:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3539:4708:x1788538641040000:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.462928:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.462936:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012e5 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462948:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3966 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.462952:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.462954:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.462955:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012e5 expref: 3966 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.462967:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3966 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.462973:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3966 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.462980:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584520448:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.462994:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009804e900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.463034:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.463044:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463045:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463048:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040064 00010000:00010000:0.0:1705683932.463052:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012ec expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.463058:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463059:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463062:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920900 00010000:00010000:0.0:1705683932.463063:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3464 pid: 15189 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.463064:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5927:16415:x1788538641040064:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.463068:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.463085:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.463086:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.463087:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ec expref: 3540 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463101:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3464 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.463105:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3464 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.463111:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584520512:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.463200:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.463227:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012f3 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.463229:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.463238:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463238:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.463239:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3966 pid: 15162 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.463242:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040384 00010000:00010000:1.0:1705683932.463244:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.463245:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.463246:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012f3 expref: 5928 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.463253:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463253:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463256:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413439 00000100:00100000:0.0:1705683932.463258:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098454100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1904:7356:x1788538641040384:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1705683932.463258:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3966 pid: 15162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.463264:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3966 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.463270:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584520640:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.463279:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.463279:0:8825:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8825:1788538584520576:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1705683932.463284:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345b40 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.463312:0:8825:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1705683932.463316:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.463325:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463325:0:8825:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.463326:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463329:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463330:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040128 00000100:00100000:3.0:1705683932.463330:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463334:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584520576 00010000:00010000:1.0:1705683932.463339:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3541 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.463344:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463345:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463347:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59904 00000100:00100000:1.0:1705683932.463349:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.463349:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+41:8825:x1788538584520576:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1705683932.463350:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463353:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333036 00000100:00100000:1.0:1705683932.463356:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:1857:x1788538641040128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.463361:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.463363:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3541 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.463369:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3541 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.463381:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084b0b980/0xefc4487a017f5814 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2caa1c expref: 3541 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.463388:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.463389:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.463391:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c9 expref: 3464 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.463395:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c9 expref: 3464 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463406:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b33200/0xefc4487a01878f1d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301308 expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.463408:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b31680/0xefc4487a01878ead lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012c9 expref: 3464 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.463419:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b26400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584520704:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.463433:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000004:00200000:0.0:1705683932.463451:0:10678:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00000100:00100000:1.0:1705683932.463467:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.463475:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463476:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463479:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040192 00000100:00100000:1.0:1705683932.463490:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463490:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463493:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920901 00000100:00100000:1.0:1705683932.463495:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:7259:x1788538641040192:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.463500:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.463526:0:10678:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b33200/0xefc4487a01878f1d lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301308 expref: 1906 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463530:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b33200/0xefc4487a01878f1d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301308 expref: 1906 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463538:0:10678:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b33200, rc 0) 00000100:00100000:0.0:1705683932.463550:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098454100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:7356:x1788538641040384:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 291us (322us total) trans 4295084979 rc 301/301 00000100:00100000:0.0:1705683932.463553:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413439 00000100:00100000:0.0:1705683932.463575:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.463581:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463581:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463585:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040256 00000100:00100000:0.0:1705683932.463593:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463593:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463596:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920902 00000100:00100000:0.0:1705683932.463599:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:6496:x1788538641040256:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.463604:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.463698:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb200/0xefc4487a01878f2b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3012fa expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.463721:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.463730:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.463731:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.463733:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb200/0xefc4487a01878f2b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012fa expref: 3542 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.463740:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb200/0xefc4487a01878f2b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012fa expref: 3542 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.463746:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7bb200, rc 0) 00000100:00100000:1.0:1705683932.463759:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3542:7259:x1788538641040192:12345-192.168.203.41@tcp:101:dd.0 Request processed in 263us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.463766:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920901 00000100:00100000:1.0:1705683932.463811:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b26900 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001_UUID:14418:1788538584520320:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.463836:0:14418:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001_UUID:14418:1788538584520384:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.463845:0:14418:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00100000:1.0:1705683932.463849:0:14418:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.463850:0:14418:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.463851:0:14418:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463892:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.463900:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463901:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463904:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040448 00010000:00010000:0.0:1705683932.463909:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b33c00/0xefc4487a01878f32 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301301 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.463912:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463913:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.463916:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920903 00000100:00100000:1.0:1705683932.463918:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:6521:x1788538641040448:12345-192.168.203.41@tcp:101:dd.0 00002000:00010000:0.0:1705683932.463919:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.463923:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.463926:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.463927:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.463929:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b33c00/0xefc4487a01878f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301301 expref: 3968 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463934:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b33c00/0xefc4487a01878f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301301 expref: 3968 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.463937:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b33c00, rc 0) 00000100:00100000:0.0:1705683932.463950:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:6496:x1788538641040256:12345-192.168.203.41@tcp:101:dd.0 Request processed in 350us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.463954:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920902 00000100:00100000:0.0:1705683932.463977:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.463986:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463987:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.463994:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040640 00000100:00100000:0.0:1705683932.464005:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464006:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464010:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107561 00000100:00100000:0.0:1705683932.464013:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:5733:x1788538641040640:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1705683932.464068:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1906:5733:x1788538641040640:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 55us (91us total) trans 4295084980 rc 0/0 00000100:00100000:0.0:1705683932.464072:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107561 00000100:00100000:0.0:1705683932.464114:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.464129:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.464135:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464135:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464139:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040704 00000100:00100000:0.0:1705683932.464157:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464158:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464162:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413440 00000100:00100000:0.0:1705683932.464165:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098453700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1906:7353:x1788538641040704:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1705683932.464181:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.464188:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131b31180/0xefc4487a01878f39 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301316 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.464220:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8f00/0xefc4487a01878f40 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30130f expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.464226:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00002000:00010000:1.0:1705683932.464230:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.464232:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464238:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.464238:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.464239:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.464241:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8f00/0xefc4487a01878f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30130f expref: 5930 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.464248:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8f00/0xefc4487a01878f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30130f expref: 5930 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.464258:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b8f00, rc 0) 00000100:00100000:1.0:1705683932.464272:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:6521:x1788538641040448:12345-192.168.203.41@tcp:101:dd.0 Request processed in 353us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.464277:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920903 00000100:00100000:1.0:1705683932.464287:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.464288:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.464291:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040512 00010000:00010000:1.0:1705683932.464298:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1908 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.464300:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.464305:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464308:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.464308:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.464309:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.464312:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333037 00000100:00100000:1.0:1705683932.464314:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1908:1857:x1788538641040512:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.464319:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.464321:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1908 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.464323:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464326:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.464326:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1908 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.464330:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464332:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464334:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d307700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.464334:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800998cad00/0xefc4487a01878610 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x419f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fce expref: 1908 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.464335:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464339:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.464343:0:6518:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:0.0:1705683932.464344:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:0.0:1705683932.464345:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.464345:0:6518:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.464346:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464348:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d307700/0xefc4487a01878f47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.464352:0:6518:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.464353:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464354:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.464356:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.464357:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464360:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d304780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.464361:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464366:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.464366:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:1857:x1788538641040512:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 51us (253us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.464369:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3231 (ffff88009d374000) 00010000:00010000:0.0:1705683932.464370:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.464370:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.464370:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333037 00010000:00010000:0.0:1705683932.464372:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d304780/0xefc4487a01878f4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.464393:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131b31180/0xefc4487a01878f39 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301316 expref: 1906 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.464398:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131b31180/0xefc4487a01878f39 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301316 expref: 1906 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.464405:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b31180, rc 0) 00000100:00100000:0.0:1705683932.464418:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098453700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:7353:x1788538641040704:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 252us (289us total) trans 0 rc 301/301 00000100:00100000:0.0:1705683932.464431:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413440 00000100:00100000:1.0:1705683932.464440:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.464451:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464452:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464456:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040832 00000100:00100000:0.0:1705683932.464472:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464472:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464476:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107562 00000100:00100000:1.0:1705683932.464477:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.464478:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.464479:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c76e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1905:7349:x1788538641040832:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1705683932.464524:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c76e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1906:7349:x1788538641040832:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 44us (84us total) trans 4295084981 rc 0/0 00000100:00100000:0.0:1705683932.464529:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107562 00000100:00100000:3.0:1705683932.464833:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133631e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+41:8825:x1788538584520576:12345-0@lo:403:mdt00_003.0 Request processed in 1482us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.464837:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59904 00000100:00100000:3.0:1705683932.464859:0:8825:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8825:1788538584520576:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1705683932.465460:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098450a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584520512:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.465471:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ec expref: 3541 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.465476:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133215a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584520448:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.465477:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b31400, rc 0) 00010000:00010000:1.0:1705683932.465486:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012e5 expref: 3967 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.465494:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999be800, rc 0) 00000100:00100000:1.0:1705683932.465511:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:6554:x1788538641039936:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2604us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.465515:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920898 00000100:00100000:0.0:1705683932.465535:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:4708:x1788538641040000:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2610us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.465539:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920899 00000100:00100000:1.0:1705683932.465552:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584520640:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.465562:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012f3 expref: 5929 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.465571:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b9180, rc 0) 00000100:00100000:0.0:1705683932.465573:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.465578:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465579:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465582:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040896 00000100:00100000:1.0:1705683932.465584:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800a5b26400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584520704:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.465591:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.465591:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.465592:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465595:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920904 00000100:00100000:0.0:1705683932.465598:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:7259:x1788538641040896:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.465602:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:1857:x1788538641040128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2245us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.465607:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333036 00010000:00010000:0.0:1705683932.465615:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.465626:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:16415:x1788538641040064:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2561us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.465631:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920900 00000100:00100000:1.0:1705683932.465662:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000040:00080000:3.0:1705683932.465673:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0xa8:0x0].1038, 656 off839280 00000100:00100000:1.0:1705683932.465702:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.465739:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.465746:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.465747:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.465751:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041088 00000100:00100000:1.0:1705683932.465762:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.465763:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.465768:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920905 00000100:00100000:1.0:1705683932.465770:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5929:16443:x1788538641041088:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.465776:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1705683932.465801:0:8825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x7a:0x0].243, 768 off237880 00000004:00080000:3.0:1705683932.465805:0:8825:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009c2ba600 with version 15697 00000004:00080000:3.0:1705683932.465814:0:7681:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff8800a94a6600 version 15697 rpc_version 15697 00000020:00100000:3.0:1705683932.465828:0:7681:0:(genops.c:2249:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1705683932.465831:0:7681:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880133631400 x1788538584520832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1472/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1705683932.465841:0:7681:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7681:1788538584520832:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1705683932.465861:0:7681:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1705683932.465869:0:7681:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.465874:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.465875:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.465879:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584520832 00010000:00010000:1.0:1705683932.465880:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30132b expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.465889:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.465889:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.465892:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3967 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.465892:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59905 00000100:00100000:3.0:1705683932.465894:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+41:7681:x1788538584520832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1705683932.465896:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.465896:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1705683932.465897:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.465897:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.465899:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30132b expref: 5930 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.465902:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641040960 00010000:00010000:1.0:1705683932.465911:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3967 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.465914:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465914:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465916:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041472 00010000:00010000:1.0:1705683932.465917:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3967 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.465919:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465920:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.465922:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413441 00000100:00100000:0.0:1705683932.465924:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7353:x1788538641040960:12345-192.168.203.41@tcp:101:lfs.0 00000100:00100000:1.0:1705683932.465924:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133211400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584520896:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.465931:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.465934:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306f80/0xefc4487a01878f5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301324 expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.465941:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.465964:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.465969:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.465974:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466001:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.466006:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00000100:00100000:1.0:1705683932.466009:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466009:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.466010:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466013:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466013:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041024 00010000:00010000:1.0:1705683932.466021:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3968 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.466026:0:10678:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466029:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466032:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466032:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466032:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.466034:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466035:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333038 00010000:00010000:0.0:1705683932.466038:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d305900 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:1.0:1705683932.466038:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1855:x1788538641041024:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.466039:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.466043:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.466050:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3968 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.466056:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3968 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.466067:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6712580/0xefc4487a018635a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x951e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb1fd expref: 3968 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.466095:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.466096:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.466098:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012e5 expref: 3967 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.466103:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012e5 expref: 3967 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466107:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466113:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:0.0:1705683932.466114:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.466114:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999be800/0xefc4487a01878f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012e5 expref: 3967 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466115:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466117:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d305900/0xefc4487a01878f63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466120:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584520960:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.466125:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466128:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466130:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.466132:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d306080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.466132:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466133:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345b40 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.466134:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.466136:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133632800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+42:7681:x1788538584520832:12345-0@lo:1000:osp_up0-1.0 Request processed in 241us (274us total) trans 4295091444 rc 0/0 00010000:00010000:0.0:1705683932.466137:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3231 (ffff88009d374100) 00010000:00010000:0.0:1705683932.466138:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.466139:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.466140:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59905 00010000:00010000:0.0:1705683932.466141:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306080/0xefc4487a01878f6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.466151:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.466158:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466158:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466162:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041280 00010000:00010000:0.0:1705683932.466163:0:10678:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306f80/0xefc4487a01878f5c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301324 expref: 1908 pid: 10678 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.466164:0:7681:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133631400 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7681:1788538584520832:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1705683932.466168:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d306f80/0xefc4487a01878f5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301324 expref: 1908 pid: 10678 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.466169:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466170:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466172:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920906 00010000:00010000:0.0:1705683932.466173:0:10678:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d306f80, rc 0) 00000100:00100000:3.0:1705683932.466173:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.466173:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466175:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3540:6496:x1788538641041280:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.466179:0:6532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413442 00010000:00010000:1.0:1705683932.466180:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.466182:0:6532:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7355:x1788538641041472:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.466189:0:6532:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.466200:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7353:x1788538641040960:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 262us (526us total) trans 0 rc 301/301 00000100:00100000:0.0:1705683932.466206:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413441 00010000:00010000:0.0:1705683932.466221:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d304f00/0xefc4487a01878f71 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9645:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30131d expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.466229:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9645:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.466236:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.466238:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.466240:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d304f00/0xefc4487a01878f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30131d expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466246:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d304f00/0xefc4487a01878f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30131d expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466256:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d304f00, rc 0) 00000100:00100000:0.0:1705683932.466266:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:7259:x1788538641040896:12345-192.168.203.41@tcp:101:dd.0 Request processed in 668us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.466269:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920904 00010000:00010000:3.0:1705683932.466282:0:6532:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6300/0xefc4487a01878f78 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301339 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466292:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.466314:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000004:00200000:3.0:1705683932.466339:0:6532:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00000100:00100000:1.0:1705683932.466351:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466352:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466357:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041216 00010000:00010000:1.0:1705683932.466366:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3968 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.466370:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.466376:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466376:0:6532:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6300/0xefc4487a01878f78 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301339 expref: 1908 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466377:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466380:0:6532:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6300/0xefc4487a01878f78 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301339 expref: 1908 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.466381:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466382:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466383:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041152 00010000:00010000:3.0:1705683932.466385:0:6532:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d2e6300, rc 0) 00010000:00010000:1.0:1705683932.466390:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3465 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.466403:0:6532:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7355:x1788538641041472:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 220us (702us total) trans 4295084983 rc 301/301 00000100:00100000:1.0:1705683932.466405:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466406:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.466406:0:6532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413442 00000100:00100000:1.0:1705683932.466409:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333039 00000100:00100000:1.0:1705683932.466411:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1855:x1788538641041216:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.466417:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.466419:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3968 pid: 15162 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.466424:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3968 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.466431:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041536 00010000:00010000:1.0:1705683932.466434:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af30a00/0xefc4487a0181efd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9abc expref: 3968 pid: 15162 timeout: 805 lvb_type: 0 00000004:00200000:3.0:1705683932.466435:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x40c9:0x0]: returning size 4096 00000100:00100000:0.0:1705683932.466439:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.466439:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.466441:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.466442:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.466444:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333040 00010000:00010000:1.0:1705683932.466444:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012f3 expref: 5930 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466446:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098452d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3466:1855:x1788538641041152:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.466448:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012f3 expref: 5930 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.466448:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.466451:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.466453:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466457:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.466459:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3466 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.466461:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bea80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.466462:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9180/0xefc4487a01878f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012f3 expref: 5930 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466463:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3466 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.466463:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466467:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.466468:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584521024:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.466472:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ac780/0xefc4487a01847a38 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccaf expref: 3466 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.466476:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x19d:0x0].0x0 (ffff880073f83400) 00010000:00010000:3.0:1705683932.466479:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1705683932.466480:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.466481:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.466481:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 2/0,0 mode: --/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.466484:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ec expref: 3540 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.466484:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800834983c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.466484:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bea80/0xefc4487a01878e4b lrc: 0/0,0 mode: --/EX res: [0x240000400:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.466489:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ec expref: 3540 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.466500:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.466501:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb480/0xefc4487a01878f86 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x838f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301332 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466502:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b31400/0xefc4487a01878f0f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3012ec expref: 3540 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.466505:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466509:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098454600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584521088:192.168.203.41@tcp:105: 00002000:00010000:1.0:1705683932.466511:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x838f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.466514:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.466518:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.466519:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.466521:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb480/0xefc4487a01878f86 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301332 expref: 3541 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.466528:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c7bb480/0xefc4487a01878f86 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x838f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301332 expref: 3541 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.466528:0:8825:0:(ldlm_lockd.c:2223:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1705683932.466533:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7bb480, rc 0) 00000004:00080000:3.0:1705683932.466533:0:8825:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x118:0x0] 00010000:00010000:3.0:1705683932.466540:0:8828:0:(ldlm_lockd.c:2852:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1705683932.466543:0:8828:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.466544:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:6496:x1788538641041280:12345-192.168.203.41@tcp:101:dd.0 Request processed in 369us (393us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.466547:0:8828:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bc280 already unused, calling callback (ffffffffa0d76510) 00000100:00100000:1.0:1705683932.466549:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920906 00010000:00010000:3.0:1705683932.466550:0:8828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1705683932.466554:0:8828:0:(mdt_handler.c:3677:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466569:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.466570:0:8828:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.466576:0:8828:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1705683932.466586:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.466586:0:8828:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466589:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466589:0:8828:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800999bc280/0xefc4487a01878e52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xefc4487a01878e60 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.466590:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.466594:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920907 00000100:00100000:1.0:1705683932.466595:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466596:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.466597:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3465:6521:x1788538641041536:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.466599:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041344 00010000:00010000:3.0:1705683932.466599:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.466599:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1705683932.466600:0:8828:0:(ldlm_lockd.c:2855:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1705683932.466602:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.466607:0:3081:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584521152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.466608:0:6518:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1907 pid: 14233 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.466618:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466618:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466621:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333041 00000100:00100000:1.0:1705683932.466624:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315db700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:1857:x1788538641041344:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.466625:0:3081:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1705683932.466629:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.466632:0:6518:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1907 pid: 14233 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.466637:0:6518:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1907 pid: 14233 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.466645:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007366c500/0xefc4487a01877ae1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x419f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f300c39 expref: 1907 pid: 14233 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.466654:0:6518:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:1.0:1705683932.466656:0:6518:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466660:0:6518:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466663:0:6518:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.466670:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.466673:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.466675:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466679:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466683:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bfc00 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:1.0:1705683932.466685:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315db700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1906:1857:x1788538641041344:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 60us (101us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.466685:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466689:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.466690:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333041 00010000:00010000:3.0:1705683932.466695:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x40c9:0x0].0x0 (ffff880073f83f00) 00010000:00010000:3.0:1705683932.466697:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1705683932.466698:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.466699:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466699:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466701:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bfc00/0xefc4487a01878e44 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x40c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.466702:0:6518:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584521152 00000100:00100000:1.0:1705683932.466728:0:6518:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466729:0:6518:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.466732:0:6518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73802 00000100:00100000:1.0:1705683932.466734:0:6518:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+42:3081:x1788538584521152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.466739:0:6518:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.466746:0:6518:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb98f00/0xefc4487a01878e60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x118:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xefc4487a01878e52 expref: 42 pid: 14256 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.466757:0:6518:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x118:0x0].0x0 (ffff8800a0fc4400) 00010000:00010000:1.0:1705683932.466763:0:6518:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.466791:0:6518:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+41:3081:x1788538584521152:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.466795:0:6518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73802 00000100:00100000:3.0:1705683932.466800:0:3081:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3081:1788538584521152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.466811:0:14418:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466816:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:0.0:1705683932.466818:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a742800/0xefc4487a01878f8d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301340 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.466826:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.466833:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.466834:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.466837:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a742800/0xefc4487a01878f8d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301340 expref: 3466 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466844:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a742800/0xefc4487a01878f8d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301340 expref: 3466 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.466850:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a742800, rc 0) 00000100:00100000:0.0:1705683932.466863:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3466:6521:x1788538641041536:12345-192.168.203.41@tcp:101:dd.0 Request processed in 266us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.466867:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920907 00010000:00010000:1.0:1705683932.466869:0:14418:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 00010000:00010000:1.0:1705683932.466875:0:14418:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466879:0:14418:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.466890:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.466897:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466904:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466908:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.466913:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.466913:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466916:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a6cf3700 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:0.0:1705683932.466918:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466918:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.466919:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466922:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.466923:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041664 00010000:00010000:3.0:1705683932.466928:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42cb:0x0].0x0 (ffff880073f83200) 00010000:00010000:3.0:1705683932.466930:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.466931:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.466935:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.466935:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf3700/0xefc4487a01878e36 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42cb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.466936:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.466937:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.466938:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107563 00000100:00100000:0.0:1705683932.466940:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1906:7349:x1788538641041664:12345-192.168.203.41@tcp:33:lfs.0 00010000:00010000:1.0:1705683932.466942:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466945:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00000004:00010000:3.0:1705683932.466948:0:8825:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88009bc18000 reply state ffff880131c45000 transno 4295084982 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0000/0xefc4487a01878e3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42cb:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466955:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6cf0000/0xefc4487a01878e3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x42cb:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.466960:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42cb:0x0].0x3131 (ffff880073f83d00) 00010000:00010000:3.0:1705683932.466962:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.466969:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008c7ba300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.466971:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466974:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.466979:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.466980:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff88012d410200) 00000100:00100000:3.0:1705683932.466980:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00200000:0.0:1705683932.466982:0:14361:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4091:0x0]: returning size 4096 00010000:00010000:1.0:1705683932.466982:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1705683932.466983:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00000004:00200000:0.0:1705683932.466984:0:14361:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1705683932.466985:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041600 00010000:00010000:1.0:1705683932.466987:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c7ba300/0xefc4487a01878f94 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.466997:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.467000:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.467001:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.467001:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.467004:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.467005:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413443 00010000:00010000:1.0:1705683932.467007:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bf980 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:0.0:1705683932.467008:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7349:x1788538641041664:12345-192.168.203.41@tcp:33:lfs.0 Request processed in 67us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.467008:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00000100:00100000:3.0:1705683932.467009:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098455a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7352:x1788538641041600:12345-192.168.203.41@tcp:101:mkdir.0 00000100:00100000:0.0:1705683932.467012:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107563 00010000:00010000:1.0:1705683932.467015:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.467017:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.467019:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x419f:0x0].0x0 (ffff88013513e900) 00010000:00010000:1.0:1705683932.467020:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1705683932.467021:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467025:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf980/0xefc4487a01878f01 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x419f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467033:0:14418:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467036:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.467039:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.467039:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.467042:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.467042:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.467043:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467045:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041728 00010000:00010000:1.0:1705683932.467045:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bf200 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.467046:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467049:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:3.0:1705683932.467050:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6a80/0xefc4487a01878f9b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301347 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.467052:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467052:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467054:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107564 00010000:00010000:1.0:1705683932.467055:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00000100:00100000:0.0:1705683932.467056:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098457300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7356:x1788538641041728:12345-192.168.203.41@tcp:33:lfs.0 00010000:00010000:1.0:1705683932.467056:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.467057:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467061:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bf200/0xefc4487a01878ee5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467067:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467070:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467073:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467075:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bd400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.467092:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467096:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467101:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88009d2b7100) 00010000:00010000:1.0:1705683932.467102:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.467103:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467106:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bd400/0xefc4487a01878ef3 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00000004:00200000:0.0:1705683932.467109:0:14361:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00000004:00200000:0.0:1705683932.467111:0:14361:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1705683932.467113:0:14418:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467116:0:14418:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467119:0:14418:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467122:0:14418:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800999bde00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.467123:0:14418:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467126:0:14418:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467130:0:14418:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3731 (ffff88009d2b7900) 00010000:00010000:1.0:1705683932.467131:0:14418:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.467132:0:14418:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00010000:00010000:1.0:1705683932.467136:0:14418:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999bde00/0xefc4487a01878efa lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT1 00000100:00100000:0.0:1705683932.467137:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098457300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1908:7356:x1788538641041728:12345-192.168.203.41@tcp:33:lfs.0 Request processed in 79us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.467140:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107564 00010000:00010000:3.0:1705683932.467140:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.467148:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467154:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:1.0:1705683932.467158:0:14418:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7318:x1788538641039744:12345-192.168.203.41@tcp:36:mrename.0 Request processed in 5035us (5271us total) trans 0 rc -39/-39 00000100:00100000:1.0:1705683932.467162:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413438 00000100:00100000:1.0:1705683932.467199:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133211400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584520896:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.467208:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30132b expref: 5930 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.467215:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b8780, rc 0) 00000100:00100000:0.0:1705683932.467222:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.467223:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:16443:x1788538641041088:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1452us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.467227:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920905 00000100:00100000:0.0:1705683932.467230:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467231:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467235:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041792 00010000:00010000:0.0:1705683932.467243:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3968 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.467254:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467255:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.467258:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333042 00010000:00010000:3.0:1705683932.467259:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00000100:00100000:0.0:1705683932.467261:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098451400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641041792:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.467264:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.467266:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.467267:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3968 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.467269:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.467271:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3968 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.467290:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801333b5900/0xefc4487a017f659d lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb2f1 expref: 3968 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.467296:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.467297:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.467299:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30132b expref: 5929 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.467306:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30132b expref: 5929 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.467317:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c7b8780/0xefc4487a01878f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30132b expref: 5929 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.467321:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584521216:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.467327:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.467333:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.467334:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab780 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.467338:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:3.0:1705683932.467356:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41a5:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.467359:0:14377:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.467366:0:14377:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467373:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467377:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467380:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467382:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467384:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e5680 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.467385:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467387:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467390:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.467391:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.467392:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467394:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5680/0xefc4487a01878fa2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467399:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467401:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467403:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467405:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009d2e5b80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.467406:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467408:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467410:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff880135adf000) 00010000:00010000:3.0:1705683932.467411:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.467411:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467413:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e5b80/0xefc4487a01878fa9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.467435:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6a80/0xefc4487a01878f9b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1908 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.467443:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1907 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.467447:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880135adfa00) 00010000:00010000:3.0:1705683932.467448:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.467449:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d2e4780, rc 0) 00000100:00100000:3.0:1705683932.467480:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098455a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7352:x1788538641041600:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 470us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.467485:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413443 00000100:00100000:3.0:1705683932.467510:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1799:7185:x1788538641038784:12345-192.168.203.41@tcp:36:rm.0 Request processed in 8219us (8259us total) trans 4295084982 rc 0/0 00000100:00100000:3.0:1705683932.467516:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413433 00000100:00100000:0.0:1705683932.468379:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098454600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584521088:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.468386:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.468395:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098452d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3465:1855:x1788538641041152:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1949us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.468399:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333040 00000100:00100000:1.0:1705683932.468402:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584520960:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.468412:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.468415:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.468425:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:1855:x1788538641041024:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2386us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.468430:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333038 00000100:00100000:0.0:1705683932.468434:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.468466:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584521024:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.468474:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.468483:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3966:1855:x1788538641041216:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2071us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.468488:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333039 00000100:00100000:1.0:1705683932.468498:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468499:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.468501:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.468503:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041856 00000100:00100000:0.0:1705683932.468507:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.468508:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.468511:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041920 00000100:00100000:1.0:1705683932.468513:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468513:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468515:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641041984 00000100:00100000:0.0:1705683932.468518:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.468518:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.468520:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920908 00000100:00100000:0.0:1705683932.468522:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:7259:x1788538641041856:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.468523:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468524:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.468527:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.468527:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920909 00000100:00100000:1.0:1705683932.468530:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3967:6496:x1788538641041920:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.468536:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.468701:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a742580/0xefc4487a01878fb7 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30134e expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.468720:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.468727:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.468728:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.468730:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a742580/0xefc4487a01878fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30134e expref: 3542 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.468735:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a742580/0xefc4487a01878fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30134e expref: 3542 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.468739:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a742580, rc 0) 00010000:00010000:1.0:1705683932.468740:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9b80/0xefc4487a01878fbe lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301355 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.468749:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3542:7259:x1788538641041856:12345-192.168.203.41@tcp:101:dd.0 Request processed in 226us (334us total) trans 0 rc 0/0 00002000:00010000:1.0:1705683932.468750:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.468751:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920908 00000100:00100000:0.0:1705683932.468758:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.468758:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.468759:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.468759:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.468761:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920910 00000100:00100000:0.0:1705683932.468762:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:4708:x1788538641041984:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.468762:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9b80/0xefc4487a01878fbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301355 expref: 3968 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.468766:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.468773:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9b80/0xefc4487a01878fbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301355 expref: 3968 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.468779:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b9b80, rc 0) 00000100:00100000:1.0:1705683932.468793:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:6496:x1788538641041920:12345-192.168.203.41@tcp:101:dd.0 Request processed in 263us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.468797:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920909 00010000:00010000:0.0:1705683932.468823:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30135c expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.468830:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5929 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.468833:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.468833:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.468834:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30135c expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.468882:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5929 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.468887:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5929 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.468891:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584521280:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.468902:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009d1ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.468920:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.468951:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468952:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468963:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042112 00000100:00100000:0.0:1705683932.468972:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.468976:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468976:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.468980:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920911 00000100:00100000:1.0:1705683932.468983:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880132356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:6521:x1788538641042112:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.468986:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.468989:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.469004:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469006:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469013:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042048 00000100:00100000:0.0:1705683932.469032:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584521216:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.469038:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.469039:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.469039:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469043:0:6532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413444 00000100:00100000:0.0:1705683932.469046:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098451400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1856:x1788538641041792:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1785us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.469046:0:6532:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1907:7353:x1788538641042048:12345-192.168.203.41@tcp:101:lfs.0 00000100:00100000:0.0:1705683932.469050:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333042 00010000:00010000:3.0:1705683932.469053:0:6532:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.469070:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.469097:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.469107:0:6532:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6080/0xefc4487a01878fcc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30136a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.469108:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.469118:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.469123:0:10679:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469123:0:10679:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469127:0:10679:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042240 00000100:00100000:0.0:1705683932.469135:0:10679:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469135:0:10679:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469136:0:10679:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042560 00000100:00100000:0.0:1705683932.469141:0:10679:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469141:0:10679:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469143:0:10679:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107565 00000100:00100000:0.0:1705683932.469145:0:10679:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf0500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1910:7355:x1788538641042240:12345-192.168.203.41@tcp:35:lfs.0 00010000:00010000:3.0:1705683932.469155:0:6532:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 00010000:00010000:3.0:1705683932.469162:0:6532:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 00010000:00010000:3.0:1705683932.469168:0:6532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00000004:00200000:3.0:1705683932.469188:0:6532:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x422f:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.469190:0:6532:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1705683932.469197:0:10679:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf0500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1911:7355:x1788538641042240:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 51us (211us total) trans 4295084984 rc 0/0 00000004:00010000:3.0:1705683932.469198:0:6532:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00000100:00100000:0.0:1705683932.469200:0:10679:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107565 00000100:00100000:0.0:1705683932.469205:0:10679:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469205:0:10679:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469207:0:10679:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107566 00000100:00100000:0.0:1705683932.469209:0:10679:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1911:7349:x1788538641042560:12345-192.168.203.41@tcp:35:lfs.0 00010000:00010000:3.0:1705683932.469220:0:6532:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e6080/0xefc4487a01878fcc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30136a expref: 1911 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.469232:0:6532:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30136a expref: 1911 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.469241:0:6532:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.469243:0:6532:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.469245:0:6532:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0e78c80, rc 0) 00010000:00010000:1.0:1705683932.469253:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9400/0xefc4487a01878fda lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301363 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.469264:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.469265:0:6532:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf2800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1911:7353:x1788538641042048:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 217us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.469269:0:6532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413444 00010000:00010000:1.0:1705683932.469272:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.469273:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.469274:0:10679:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1911:7349:x1788538641042560:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 29us (120us total) trans 4295084985 rc 0/0 00010000:00010000:1.0:1705683932.469275:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9400/0xefc4487a01878fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301363 expref: 5931 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.469278:0:10679:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107566 00000100:00100000:3.0:1705683932.469279:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469280:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.469282:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c7b9400/0xefc4487a01878fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301363 expref: 5931 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.469283:0:6532:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042368 00010000:00010000:1.0:1705683932.469291:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b9400, rc 0) 00000100:00100000:3.0:1705683932.469295:0:6532:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469296:0:6532:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469299:0:6532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413445 00000100:00100000:0.0:1705683932.469300:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.469302:0:6532:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1910:7352:x1788538641042368:12345-192.168.203.41@tcp:101:mkdir.0 00000100:00100000:1.0:1705683932.469306:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880132356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5931:6521:x1788538641042112:12345-192.168.203.41@tcp:101:dd.0 Request processed in 322us (384us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.469309:0:6532:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.469310:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920911 00010000:00010000:3.0:1705683932.469314:0:6532:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78000/0xefc4487a01878fe1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301378 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.469320:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469321:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469324:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042304 00000100:00100000:1.0:1705683932.469335:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469335:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469337:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042432 00000100:00100000:0.0:1705683932.469344:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.469344:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469344:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469346:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042624 00000100:00100000:0.0:1705683932.469349:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469350:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469352:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469353:0:14361:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042752 00000100:00100000:1.0:1705683932.469353:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469356:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920912 00000100:00100000:1.0:1705683932.469359:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3466:16415:x1788538641042304:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.469360:0:14361:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.469360:0:14361:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.469360:0:6532:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 00000100:00100000:0.0:1705683932.469362:0:14361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107567 00000100:00100000:0.0:1705683932.469364:0:14361:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c76d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1799:7185:x1788538641042752:12345-192.168.203.41@tcp:35:rm.0 00010000:00010000:1.0:1705683932.469365:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.469367:0:6532:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 00010000:00010000:3.0:1705683932.469372:0:6532:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00000004:00200000:3.0:1705683932.469386:0:6532:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41a6:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.469387:0:6532:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.469392:0:6532:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 00010000:00010000:3.0:1705683932.469408:0:6532:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78000/0xefc4487a01878fe1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x41a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301378 expref: 1912 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.469409:0:14361:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c76d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_010:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7185:x1788538641042752:12345-192.168.203.41@tcp:35:rm.0 Request processed in 43us (64us total) trans 4295084986 rc 0/0 00000100:00100000:0.0:1705683932.469412:0:14361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107567 00010000:00010000:3.0:1705683932.469416:0:6532:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301378 expref: 1911 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.469419:0:6532:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a6:0x0].0x0 (ffff8800a6e37c00) 00010000:00010000:3.0:1705683932.469420:0:6532:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.469421:0:6532:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0e7a800, rc 0) 00000100:00100000:3.0:1705683932.469435:0:6532:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1911:7352:x1788538641042368:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.469439:0:6532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413445 00010000:00010000:1.0:1705683932.469492:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301371 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.469501:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.469503:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3542 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469507:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.469509:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.469510:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301371 expref: 3467 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469526:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3542 pid: 15188 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.469530:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.469531:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3542 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.469531:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469536:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042816 00000100:00100000:1.0:1705683932.469537:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584521344:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.469551:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469552:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.469557:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413446 00000100:00100000:1.0:1705683932.469558:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800834983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.469560:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1800:7326:x1788538641042816:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.469566:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.469569:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469570:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469575:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920913 00000100:00100000:1.0:1705683932.469578:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3542:6554:x1788538641042432:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.469584:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.469597:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78280/0xefc4487a01878ff6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30138d expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469605:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30137f expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469616:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3543 pid: 15098 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.469621:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.469622:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.469623:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30137f expref: 3543 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469635:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3543 pid: 15098 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.469642:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3543 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.469648:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584521408:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.469663:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.469670:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00000100:00100000:1.0:1705683932.469675:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345b40 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.469676:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:1.0:1705683932.469686:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469687:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.469693:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920914 00000100:00100000:1.0:1705683932.469696:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3467:16443:x1788538641042624:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.469701:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.469774:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.469779:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469782:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:1.0:1705683932.469787:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301386 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469799:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3543 pid: 15102 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469804:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.469805:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.469806:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301386 expref: 3468 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469818:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3543 pid: 15102 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.469824:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3543 pid: 15102 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.469826:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.469829:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00000100:00100000:1.0:1705683932.469831:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584521472:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.469832:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:3.0:1705683932.469844:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41ef:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.469846:0:14377:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1705683932.469850:0:14377:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469853:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:1.0:1705683932.469855:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.469856:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469858:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469860:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469865:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0e7b480 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.469866:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469869:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469872:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.469873:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.469874:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469876:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7b480/0xefc4487a01879004 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469882:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469884:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469886:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469888:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0e79900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.469889:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469890:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469892:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x30 (ffff880135adfc00) 00010000:00010000:3.0:1705683932.469893:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.469894:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469897:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79900/0xefc4487a0187900b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.469915:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78280/0xefc4487a01878ff6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30138d expref: 1802 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.469920:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30138d expref: 1801 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.469923:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff880135adf200) 00010000:00010000:3.0:1705683932.469924:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.469925:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0e7aa80, rc 0) 00000100:00100000:3.0:1705683932.469941:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1801:7326:x1788538641042816:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 381us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.469943:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413446 00000100:00100000:1.0:1705683932.471011:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315d8500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584521344:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.471024:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301371 expref: 3468 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.471032:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7bbc00, rc 0) 00000100:00100000:1.0:1705683932.471049:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3468:16415:x1788538641042304:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1689us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.471054:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920912 00000100:00100000:1.0:1705683932.471098:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.471107:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471108:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471112:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042880 00000100:00100000:1.0:1705683932.471122:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471123:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471126:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920915 00000100:00100000:1.0:1705683932.471129:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315d8500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:7259:x1788538641042880:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.471134:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.471159:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584521280:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.471215:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30135c expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471223:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a741e00, rc 0) 00000100:00100000:0.0:1705683932.471238:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:4708:x1788538641041984:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2473us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.471241:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920910 00000100:00100000:0.0:1705683932.471368:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.471377:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471378:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471387:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641042944 00010000:00010000:0.0:1705683932.471397:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5931 pid: 15148 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.471404:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314da580/0xefc4487a01879020 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9646:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301394 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.471412:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471413:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471414:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471415:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333043 00000100:00100000:1.0:1705683932.471415:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471417:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5931:1857:x1788538641042944:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.471421:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1705683932.471425:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9646:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.471427:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5931 pid: 15148 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.471431:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5931 pid: 15148 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.471431:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.471433:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.471435:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314da580/0xefc4487a01879020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301394 expref: 3968 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471440:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c9c780/0xefc4487a01847a31 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccb6 expref: 5931 pid: 15148 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.471442:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314da580/0xefc4487a01879020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301394 expref: 3968 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471447:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.471447:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.471447:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314da580, rc 0) 00010000:00010000:0.0:1705683932.471449:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30135c expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471452:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30135c expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471458:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315d8500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:7259:x1788538641042880:12345-192.168.203.41@tcp:101:dd.0 Request processed in 329us (361us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.471461:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a741e00/0xefc4487a01878fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30135c expref: 3968 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471462:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920915 00000100:00100000:0.0:1705683932.471465:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098450000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584521536:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.471477:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.471494:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.471501:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471501:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471504:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043008 00000100:00100000:0.0:1705683932.471506:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.471511:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3544 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.471518:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471519:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471521:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.471521:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333044 00000100:00100000:1.0:1705683932.471524:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:1857:x1788538641043008:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.471528:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.471530:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3544 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.471534:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.471535:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3544 pid: 15188 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.471549:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800981cc280/0xefc4487a0181f1a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9b1e expref: 3544 pid: 15188 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.471556:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.471556:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.471557:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.471557:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471560:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.471560:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301371 expref: 3467 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.471562:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043456 00010000:00010000:1.0:1705683932.471565:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301371 expref: 3467 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.471566:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471567:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471571:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043264 00000100:00100000:3.0:1705683932.471572:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.471572:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.471574:0:14377:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043200 00010000:00010000:1.0:1705683932.471578:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c7bbc00/0xefc4487a01878fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301371 expref: 3467 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471579:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3544 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.471579:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.471579:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.471583:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413447 00000100:00100000:1.0:1705683932.471586:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584521600:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.471586:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1912:16427:x1788538641043456:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.471587:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471588:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471590:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333045 00000100:00100000:0.0:1705683932.471592:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098457300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:1854:x1788538641043264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.471592:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.471593:0:14377:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1705683932.471598:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.471600:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a800/0xefc4487a01878fe8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301378 expref: 1912 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471601:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800834983c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.471605:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3544 pid: 15098 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.471608:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a6:0x0].0x0 (ffff8800a6e37c00) 00000100:00100000:1.0:1705683932.471610:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.471610:0:14377:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.471611:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3544 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.471611:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.471615:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79b80/0xefc4487a01879027 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x41a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013a2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471617:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043072 00010000:00010000:0.0:1705683932.471621:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.471622:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.471624:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30137f expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471632:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471633:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471637:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107568 00010000:00010000:0.0:1705683932.471639:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30137f expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471640:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1913:7355:x1788538641043072:12345-192.168.203.41@tcp:33:lfs.0 00010000:00010000:0.0:1705683932.471652:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30137f expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.471657:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098454600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584521664:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.471668:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39840 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.471674:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.471678:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471681:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:1.0:1705683932.471693:0:14260:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425a:0x0]: returning size 4096 00000004:00200000:1.0:1705683932.471696:0:14260:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1705683932.471729:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.471739:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471740:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.471740:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1913:7355:x1788538641043072:12345-192.168.203.41@tcp:33:lfs.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.471744:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043328 00000100:00100000:1.0:1705683932.471746:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107568 00010000:00010000:0.0:1705683932.471752:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3545 pid: 15102 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.471764:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471765:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.471768:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333046 00010000:00010000:1.0:1705683932.471769:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a634e580/0xefc4487a01863599 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb204 expref: 3545 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.471770:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3545:1854:x1788538641043328:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.471774:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.471775:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3544 pid: 15102 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.471777:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584521408:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.471779:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3544 pid: 15102 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.471788:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c7b8000/0xefc4487a01878ffd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30137f expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.471789:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.471789:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:0.0:1705683932.471790:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.471791:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301386 expref: 3467 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.471793:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c7b8000, rc 0) 00010000:00010000:3.0:1705683932.471793:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.471795:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301386 expref: 3467 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.471797:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:0.0:1705683932.471805:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301386 expref: 3467 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.471806:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:6554:x1788538641042432:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2227us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.471809:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880135575000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584521728:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.471810:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920913 00000100:00100000:0.0:1705683932.471821:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.471824:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416a80/0xefc4487a0187903c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.471829:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416a80/0xefc4487a0187903c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:1.0:1705683932.471831:0:15095:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6711680/0xefc4487a017f6a89 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cb6be expref: 3543 pid: 15102 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.471831:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416a80/0xefc4487a0187903c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:3.0:1705683932.471835:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41a8:0x0]: returning size 5 00000100:00100000:1.0:1705683932.471838:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584521472:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.471847:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801314db200/0xefc4487a01879012 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301386 expref: 3467 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.471852:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314db200, rc 0) 00000100:00100000:1.0:1705683932.471862:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098456e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3467:16443:x1788538641042624:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2165us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.471865:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920914 00010000:00010000:3.0:1705683932.471883:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471886:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471888:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471891:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471894:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0e7a300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.471895:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471899:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471904:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a6:0x0].0x0 (ffff8800a6e37c00) 00010000:00010000:3.0:1705683932.471906:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.471908:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471911:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7a300/0xefc4487a0187902e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x41a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471919:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471923:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471926:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471933:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1417c00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.471934:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471938:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471943:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a6:0x0].0x36 (ffff88009dfb0f00) 00010000:00010000:3.0:1705683932.471945:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.471946:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471949:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417c00/0xefc4487a01879035 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a6:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.471975:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e79b80/0xefc4487a01879027 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x41a6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a2 expref: 1914 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.471981:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416a80/0xefc4487a0187903c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a2 expref: 1913 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.471984:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a8:0x0].0x0 (ffff88007b07fa00) 00010000:00010000:3.0:1705683932.471985:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1705683932.471986:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1416a80, rc 0) 00000100:00100000:3.0:1705683932.472009:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1913:16427:x1788538641043456:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 423us (504us total) trans 4295084987 rc 0/0 00000100:00100000:3.0:1705683932.472012:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413447 00000100:00100000:3.0:1705683932.472018:0:14377:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.472019:0:14377:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.472022:0:14377:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413448 00000100:00100000:3.0:1705683932.472024:0:14377:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1912:7353:x1788538641043200:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1705683932.472029:0:14377:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.472029:0:14377:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1705683932.472034:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e78c80/0xefc4487a01878fd3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30136a expref: 1912 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472039:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.472040:0:14377:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.472043:0:14377:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414780/0xefc4487a0187904a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30139b expref: -99 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472104:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.472109:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472112:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472196:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416f80/0xefc4487a01879058 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x422f:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.472202:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416f80/0xefc4487a01879058 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472207:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416f80/0xefc4487a01879058 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000100:00100000:0.0:1705683932.472353:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.472363:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.472363:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.472367:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043584 00000100:00100000:0.0:1705683932.472378:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413449 00000100:00100000:0.0:1705683932.472380:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1801:7326:x1788538641043584:12345-192.168.203.41@tcp:36:lfs.0 00000100:00100000:1.0:1705683932.472380:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.472424:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.472435:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472436:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472443:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043712 00000100:00100000:0.0:1705683932.472451:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1802:7326:x1788538641043584:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 68us (98us total) trans 0 rc -17/-17 00000100:00100000:0.0:1705683932.472454:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413449 00000100:00100000:1.0:1705683932.472456:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472457:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472459:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043776 00000100:00100000:0.0:1705683932.472461:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.472461:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.472464:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413450 00000100:00100000:0.0:1705683932.472468:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1802:16469:x1788538641043712:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.472470:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472471:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.472473:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.472474:0:6531:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1705683932.472475:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413451 00000100:00100000:1.0:1705683932.472478:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1802:7333:x1788538641043776:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:0.0:1705683932.472482:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0d45180/0xefc4487a0187855a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41f0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f300fa4 expref: 1802 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.472484:0:14233:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.472491:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f0:0x0].0x0 (ffff88009e842a00) 00010000:00010000:0.0:1705683932.472492:0:6531:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.472497:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740c80/0xefc4487a0187905f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x41f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472509:0:14377:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 00010000:00010000:3.0:1705683932.472516:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472519:0:14377:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00000004:00200000:3.0:1705683932.472522:0:14377:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425f:0x0]: returning size 0 00010000:00010000:3.0:1705683932.472532:0:14377:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472535:0:14377:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472537:0:14377:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472538:0:14377:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472540:0:14377:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1415180 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.472541:0:14377:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472543:0:14377:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472546:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.472546:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.472547:0:14377:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472549:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415180/0xefc4487a01879051 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT1 00000004:00010000:3.0:1705683932.472562:0:14377:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880098453c00 reply state ffff880133170000 transno 4295084988 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416f80/0xefc4487a01879058 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472566:0:14377:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416f80/0xefc4487a01879058 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT1 00010000:00010000:3.0:1705683932.472570:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3231 (ffff88009dfb0d00) 00010000:00010000:3.0:1705683932.472571:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.472575:0:14233:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8000/0xefc4487a01879074 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013b0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472591:0:14377:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414780/0xefc4487a0187904a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1914 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472602:0:14377:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1913 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.472607:0:14377:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009dfb0700) 00010000:00010000:3.0:1705683932.472608:0:14377:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1705683932.472609:0:14377:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1415e00, rc 0) 00010000:00010000:0.0:1705683932.472616:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.472621:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472625:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:3.0:1705683932.472626:0:14377:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1914:7353:x1788538641043200:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 601us (1092us total) trans 4295084988 rc 0/0 00000100:00100000:3.0:1705683932.472631:0:14377:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413448 00010000:00010000:1.0:1705683932.472640:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:1.0:1705683932.472647:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472652:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472684:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.472689:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472693:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472733:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:1.0:1705683932.472738:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472741:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741400/0xefc4487a01879097 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:1.0:1705683932.472743:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472746:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741400/0xefc4487a01879097 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472750:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741400/0xefc4487a01879097 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:0.0:1705683932.472755:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41f1:0x0]: returning size 5 00010000:00010000:1.0:1705683932.472767:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:1.0:1705683932.472773:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472777:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000004:00200000:1.0:1705683932.472791:0:14233:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x41a5:0x0]: returning size 4096 00010000:00010000:0.0:1705683932.472792:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:1.0:1705683932.472793:0:14233:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1705683932.472795:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472797:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00000004:00010000:1.0:1705683932.472799:0:14233:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472800:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472802:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a740280 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.472803:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472805:0:14233:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472806:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472808:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472810:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472812:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f0:0x0].0x0 (ffff88009e842a00) 00010000:00010000:0.0:1705683932.472813:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.472813:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472815:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472816:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801314d8500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.472817:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472819:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740280/0xefc4487a0187907b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x41f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472820:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472824:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472825:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.472826:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472827:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.472828:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472828:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472830:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a740500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.472831:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472832:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8500/0xefc4487a01879082 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472833:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472835:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f0:0x0].0x30 (ffff88009d7ca200) 00010000:00010000:0.0:1705683932.472836:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.472837:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.472840:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740500/0xefc4487a01879089 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41f0:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.472840:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472844:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472847:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472850:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8801314d9900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.472851:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472855:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472859:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff8801352f4b00) 00010000:00010000:1.0:1705683932.472860:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.472861:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.472864:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9900/0xefc4487a01879090 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.472867:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740c80/0xefc4487a0187905f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x41f0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a9 expref: 1805 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.472890:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d8000/0xefc4487a01879074 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013b0 expref: 1805 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.472897:0:14233:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013b0 expref: 1804 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.472905:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880135adfa00) 00010000:00010000:1.0:1705683932.472907:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1705683932.472908:0:14233:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314d9e00, rc 0) 00010000:00010000:0.0:1705683932.472919:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741400/0xefc4487a01879097 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a9 expref: 1804 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.472923:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f1:0x0].0x0 (ffff8800875b2500) 00010000:00010000:0.0:1705683932.472924:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1705683932.472924:0:14233:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dda00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1804:7333:x1788538641043776:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 445us (500us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.472925:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a741400, rc 0) 00000100:00100000:1.0:1705683932.472928:0:14233:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413451 00000100:00100000:0.0:1705683932.472938:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dc600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1803:16469:x1788538641043712:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 469us (559us total) trans 4295084989 rc 0/0 00000100:00100000:0.0:1705683932.472943:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413450 00000100:00100000:0.0:1705683932.472977:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.472990:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472992:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.472996:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043840 00000100:00100000:1.0:1705683932.473007:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473007:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473010:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920916 00000100:00100000:1.0:1705683932.473013:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3543:6496:x1788538641043840:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.473018:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.473062:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.473125:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098450000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584521536:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.473133:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.473145:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:1857:x1788538641042944:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1727us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.473149:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333043 00010000:00010000:1.0:1705683932.473196:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314d8a00/0xefc4487a018790ac lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013b7 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.473207:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.473215:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473216:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473219:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314d8a00/0xefc4487a018790ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013b7 expref: 3544 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473226:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801314d8a00/0xefc4487a018790ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013b7 expref: 3544 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473232:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314d8a00, rc 0) 00000100:00100000:0.0:1705683932.473246:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098454600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584521664:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.473246:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:6496:x1788538641043840:12345-192.168.203.41@tcp:101:dd.0 Request processed in 232us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.473250:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920916 00010000:00010000:0.0:1705683932.473254:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.473263:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473264:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098457300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3543:1854:x1788538641043264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1671us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.473264:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473267:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333045 00000100:00100000:1.0:1705683932.473268:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641043968 00000100:00100000:0.0:1705683932.473289:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473289:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473290:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473291:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473295:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107569 00000100:00100000:1.0:1705683932.473297:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1914:7355:x1788538641043968:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1705683932.473316:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880135575000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584521728:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.473324:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.473333:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3542:1854:x1788538641043328:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1562us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.473336:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333046 00000100:00100000:0.0:1705683932.473361:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.473364:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1915:7355:x1788538641043968:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 62us (298us total) trans 4295084990 rc 0/0 00000100:00100000:1.0:1705683932.473370:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107569 00000100:00100000:0.0:1705683932.473372:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.473388:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.473391:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584521600:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.473399:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.473410:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:1857:x1788538641043008:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1886us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.473415:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333044 00000100:00100000:0.0:1705683932.473425:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.473433:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473434:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473438:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044032 00000100:00100000:1.0:1705683932.473442:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473443:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473446:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044096 00000100:00100000:0.0:1705683932.473456:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473457:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473458:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473459:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044160 00000100:00100000:1.0:1705683932.473459:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473461:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044224 00000100:00100000:0.0:1705683932.473465:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473465:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473468:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473468:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473469:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920917 00000100:00100000:0.0:1705683932.473472:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3467:6521:x1788538641044032:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.473472:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920918 00000100:00100000:1.0:1705683932.473475:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:6554:x1788538641044096:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.473478:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.473480:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.473519:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013c5 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473531:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3969 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.473536:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473537:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473538:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013c5 expref: 3969 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473551:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3969 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.473558:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3969 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.473565:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315db700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584521792:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.473581:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800834983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.473590:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473591:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473596:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920919 00000100:00100000:1.0:1705683932.473599:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3541:4708:x1788538641044160:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.473604:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.473663:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013cc expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473673:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3467 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.473678:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473679:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.473680:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013cc expref: 3542 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473691:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3467 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.473697:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3467 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.473703:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584521856:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.473731:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.473740:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473741:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.473747:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920920 00000100:00100000:1.0:1705683932.473750:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098454600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5930:16415:x1788538641044224:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.473756:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.473759:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a742f80/0xefc4487a018790c1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013be expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.473767:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.473773:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.473774:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.473777:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a742f80/0xefc4487a018790c1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013be expref: 3468 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.473789:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a742f80/0xefc4487a018790c1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013be expref: 3468 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.473794:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a742f80, rc 0) 00000100:00100000:0.0:1705683932.473807:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3468:6521:x1788538641044032:12345-192.168.203.41@tcp:101:dd.0 Request processed in 335us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.473812:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920917 00000100:00100000:0.0:1705683932.473838:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.473858:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473858:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473862:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044288 00000100:00100000:0.0:1705683932.473872:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473873:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.473875:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920921 00000100:00100000:0.0:1705683932.473877:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5931:16443:x1788538641044288:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.473923:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.473978:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013d3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473991:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3969 pid: 15099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.473995:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.473996:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.473998:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013d3 expref: 5932 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474009:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3969 pid: 15099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474015:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3969 pid: 15099 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.474021:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584521920:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.474034:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.474101:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.474117:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013da expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.474120:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.474127:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3969 pid: 15130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.474127:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474128:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.474130:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.474130:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.474131:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013da expref: 5933 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.474132:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044352 00010000:00010000:0.0:1705683932.474142:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3969 pid: 15130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.474142:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474143:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.474146:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3969 pid: 15130 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.474146:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920922 00000100:00100000:1.0:1705683932.474149:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3543:7259:x1788538641044352:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.474150:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098452d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584521984:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.474153:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.474198:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.474206:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474206:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474209:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044672 00000100:00100000:0.0:1705683932.474218:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474219:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474221:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413452 00000100:00100000:0.0:1705683932.474223:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801315dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1915:7353:x1788538641044672:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1705683932.474228:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.474233:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a743200/0xefc4487a018790d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013e8 expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.474287:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.474306:0:10678:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1916 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.474311:0:10678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.474318:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801314db980/0xefc4487a018790e4 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013e1 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.474324:0:10678:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1916 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.474329:0:10678:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1916 pid: 14377 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1705683932.474329:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.474336:0:10678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880098452300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10678:1788538584522048:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.474336:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.474337:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.474340:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314db980/0xefc4487a018790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013e1 expref: 3544 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474346:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801314db980/0xefc4487a018790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013e1 expref: 3544 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.474349:0:10678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39840 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.474351:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314db980, rc 0) 00000100:00100000:1.0:1705683932.474364:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:7259:x1788538641044352:12345-192.168.203.41@tcp:101:dd.0 Request processed in 215us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.474368:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920922 00000100:00100000:0.0:1705683932.474386:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.474395:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474396:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474398:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044480 00000100:00100000:1.0:1705683932.474412:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.474415:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474415:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474418:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044544 00000100:00100000:1.0:1705683932.474422:0:14196:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474423:0:14196:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474426:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.474428:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474428:0:14196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413453 00000100:00100000:0.0:1705683932.474431:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413454 00000100:00100000:1.0:1705683932.474431:0:14196:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098451400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1917:16427:x1788538641044480:12345-192.168.203.41@tcp:36:dir_create.sh.0 00000100:00100000:0.0:1705683932.474434:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133212800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1803:7333:x1788538641044544:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:0.0:1705683932.474439:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.474445:0:14196:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.474453:0:14196:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416a80/0xefc4487a0187903c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a2 expref: 1917 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474463:0:14196:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a8:0x0].0x0 (ffff88007b07fa00) 00010000:00010000:1.0:1705683932.474465:0:14196:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.474476:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741b80/0xefc4487a018790eb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013ef expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474533:0:14196:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9180/0xefc4487a018790f2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x41a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14196 initiator: MDT0 00010000:00010000:1.0:1705683932.474538:0:14196:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9180/0xefc4487a018790f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:1.0:1705683932.474542:0:14196:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9180/0xefc4487a018790f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00010000:00010000:0.0:1705683932.474544:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.474550:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474556:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000001:00080000:1.0:1705683932.474563:0:14196:0:(tgt_lastrcvd.c:2105:tgt_txn_stop_cb()) More than one transaction 4295084991 00000004:00010000:1.0:1705683932.474574:0:14196:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880098451400 reply state ffff880096612000 transno 4295084992 ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9180/0xefc4487a018790f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00010000:00010000:1.0:1705683932.474579:0:14196:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9180/0xefc4487a018790f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x41a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:1.0:1705683932.474582:0:14196:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a8:0x0].0x0 (ffff88007b07fa00) 00010000:00010000:1.0:1705683932.474583:0:14196:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1705683932.474608:0:14196:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098451400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1919:16427:x1788538641044480:12345-192.168.203.41@tcp:36:dir_create.sh.0 Request processed in 176us (222us total) trans 4295084992 rc 0/0 00000100:00100000:1.0:1705683932.474612:0:14196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413453 00000020:00080000:1.0:1705683932.474614:0:14196:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1705683932.474623:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.474626:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474629:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.474667:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.474676:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474677:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474681:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044800 00000100:00100000:1.0:1705683932.474692:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474693:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474697:0:14205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413455 00000100:00100000:1.0:1705683932.474700:0:14205:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1805:16469:x1788538641044800:12345-192.168.203.41@tcp:36:dir_create.sh.0 00010000:00010000:1.0:1705683932.474728:0:14205:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.474736:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741400/0xefc4487a01879097 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41f1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013a9 expref: 1805 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474743:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f1:0x0].0x0 (ffff8800875b2500) 00010000:00010000:1.0:1705683932.474745:0:14205:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.474749:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:0.0:1705683932.474754:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474757:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000004:00200000:0.0:1705683932.474781:0:6531:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4091:0x0]: returning size 4096 00000004:00200000:0.0:1705683932.474783:0:6531:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1705683932.474788:0:6531:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474792:0:6531:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474794:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474796:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474799:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474806:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a742300 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.474807:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474810:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.474810:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53c00/0xefc4487a0187910e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x41f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:0.0:1705683932.474813:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:0.0:1705683932.474814:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.474815:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474817:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a742300/0xefc4487a018790f9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.474819:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53c00/0xefc4487a0187910e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:0.0:1705683932.474823:0:6531:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.474823:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53c00/0xefc4487a0187910e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:0.0:1705683932.474825:0:6531:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474826:0:6531:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474828:0:6531:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a369900 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.474829:0:6531:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474832:0:6531:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 00010000:00010000:0.0:1705683932.474836:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88009d374900) 00010000:00010000:0.0:1705683932.474837:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.474838:0:6531:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000001:00080000:1.0:1705683932.474841:0:14205:0:(tgt_lastrcvd.c:2105:tgt_txn_stop_cb()) More than one transaction 4295084993 00010000:00010000:0.0:1705683932.474842:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369900/0xefc4487a01879100 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 00000004:00010000:1.0:1705683932.474853:0:14205:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880133215500 reply state ffff880096611000 transno 4295084994 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53c00/0xefc4487a0187910e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.474859:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53c00/0xefc4487a0187910e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x41f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:0.0:1705683932.474861:0:6531:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a741b80/0xefc4487a018790eb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013ef expref: 1807 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.474863:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f1:0x0].0x0 (ffff8800875b2500) 00010000:00010000:1.0:1705683932.474864:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.474867:0:6531:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013ef expref: 1806 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.474870:0:6531:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4091:0x0].0x0 (ffff88009b857600) 00010000:00010000:0.0:1705683932.474871:0:6531:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1705683932.474872:0:6531:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36bc00, rc 0) 00000100:00100000:0.0:1705683932.474882:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133212800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1807:7333:x1788538641044544:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 448us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.474886:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413454 00000100:00100000:1.0:1705683932.474892:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1806:16469:x1788538641044800:12345-192.168.203.41@tcp:36:dir_create.sh.0 Request processed in 190us (224us total) trans 4295084994 rc 0/0 00000100:00100000:1.0:1705683932.474896:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413455 00000020:00080000:1.0:1705683932.474898:0:14205:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1705683932.474953:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.474966:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474966:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474971:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044864 00000100:00100000:1.0:1705683932.474981:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474981:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.474984:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920923 00000100:00100000:1.0:1705683932.474987:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:6496:x1788538641044864:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.474992:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.475186:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca52080/0xefc4487a01879115 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x920f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013f6 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.475196:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x920f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.475205:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.475206:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.475208:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca52080/0xefc4487a01879115 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013f6 expref: 3971 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.475215:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca52080/0xefc4487a01879115 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x920f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013f6 expref: 3971 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.475221:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca52080, rc 0) 00000100:00100000:1.0:1705683932.475234:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:6496:x1788538641044864:12345-192.168.203.41@tcp:101:dd.0 Request processed in 246us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.475239:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920923 00000100:00100000:1.0:1705683932.475778:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315db700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584521792:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.475790:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013c5 expref: 3970 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.475798:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314d8280, rc 0) 00000100:00100000:1.0:1705683932.475816:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:6554:x1788538641044096:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2339us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.475820:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920918 00000100:00100000:0.0:1705683932.475831:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098452d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584521984:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.475840:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584521856:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.475842:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013da expref: 5933 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.475849:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013cc expref: 3543 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.475850:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a741900, rc 0) 00010000:00010000:1.0:1705683932.475856:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314d8780, rc 0) 00000100:00100000:0.0:1705683932.475863:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5933:16443:x1788538641044288:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1985us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.475867:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920921 00000100:00100000:1.0:1705683932.475868:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3543:4708:x1788538641044160:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2269us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.475874:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920919 00000100:00100000:1.0:1705683932.475891:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8801315dd000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584521920:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.475900:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013d3 expref: 5932 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.475907:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801314daf80, rc 0) 00000100:00100000:1.0:1705683932.475922:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098454600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5932:16415:x1788538641044224:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2171us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.475926:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920920 00000100:00100000:0.0:1705683932.476106:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.476118:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476119:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476124:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044928 00000100:00100000:0.0:1705683932.476130:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.476134:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3970 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.476139:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476140:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476144:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045056 00000100:00100000:1.0:1705683932.476147:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476147:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476150:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333047 00000100:00100000:1.0:1705683932.476153:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880098452d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1854:x1788538641044928:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.476158:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.476166:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3970 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476172:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3970 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476188:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095966f80/0xefc4487a01863625 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x951f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb227 expref: 3970 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476194:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.476196:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.476197:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013c5 expref: 3970 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.476203:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3970 pid: 15099 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.476203:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013c5 expref: 3970 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.476217:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801314d8280/0xefc4487a018790b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x951f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013c5 expref: 3970 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476224:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133213c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584522112:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.476244:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.476258:0:10678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880098452300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10678:1788538584522048:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.476267:0:10678:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00100000:1.0:1705683932.476272:0:10678:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.476273:0:10678:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.476274:0:10678:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476276:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476277:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476281:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333048 00000100:00100000:0.0:1705683932.476285:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1854:x1788538641045056:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.476291:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.476293:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3970 pid: 15099 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.476293:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.476300:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3970 pid: 15099 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.476303:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476304:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476308:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045184 00010000:00010000:0.0:1705683932.476310:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aed8280/0xefc4487a0181f424 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9bc6 expref: 3970 pid: 15099 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.476316:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1919 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.476319:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.476321:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.476327:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476327:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476331:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333049 00000100:00100000:1.0:1705683932.476334:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1919:1854:x1788538641045184:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.476338:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.476341:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1919 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.476346:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1919 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.476354:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415e00/0xefc4487a01879066 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f30139b expref: 1919 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.476363:0:15238:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009dfb0700) 00010000:00010000:1.0:1705683932.476366:0:15238:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476370:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476374:0:15238:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476383:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.476391:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013d3 expref: 5931 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476394:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1918:1854:x1788538641045184:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 59us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.476398:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013d3 expref: 5931 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476399:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333049 00010000:00010000:1.0:1705683932.476414:0:10678:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.476416:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801314daf80/0xefc4487a018790c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013d3 expref: 5931 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.476418:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.476423:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584522176:192.168.203.41@tcp:105: 00000004:00200000:1.0:1705683932.476425:0:10678:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x425f:0x0]: returning size 0 00000100:00100000:0.0:1705683932.476482:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.476507:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.476508:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476513:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.476515:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476516:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.476517:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.476520:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641044992 00010000:00010000:1.0:1705683932.476521:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009a740780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.476522:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476526:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.476529:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3468 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476531:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009dfb0700) 00010000:00010000:1.0:1705683932.476533:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1705683932.476534:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.476538:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a740780/0xefc4487a018790dd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x425f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.476548:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476549:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476553:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333050 00000100:00100000:0.0:1705683932.476555:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3468:1854:x1788538641044992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.476561:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.476569:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3468 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476574:0:10678:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a743200/0xefc4487a018790d6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013e8 expref: 1918 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.476575:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3468 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476584:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a743200/0xefc4487a018790d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013e8 expref: 1918 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.476587:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800959a8a00/0xefc4487a01847a3f lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccbd expref: 3468 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.476590:0:10678:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a743200, rc 0) 00010000:00010000:0.0:1705683932.476599:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.476600:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.476602:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013cc expref: 3542 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476604:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801315dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1917:7353:x1788538641044672:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 2380us (2503us total) trans 4295084995 rc 301/301 00010000:00010000:0.0:1705683932.476607:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013cc expref: 3542 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476609:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413452 00010000:00010000:0.0:1705683932.476620:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801314d8780/0xefc4487a018790ba lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013cc expref: 3542 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.476627:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584522240:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.476644:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.476650:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.476665:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476666:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476670:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045120 00000100:00100000:1.0:1705683932.476677:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.476679:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3970 pid: 15130 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.476697:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476697:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476701:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333051 00000100:00100000:1.0:1705683932.476701:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476701:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476704:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1854:x1788538641045120:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.476722:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.476725:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3970 pid: 15130 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.476726:0:15128:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.476729:0:15128:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.476735:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3970 pid: 15130 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.476737:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.476742:0:15128:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045248 00000100:00100000:1.0:1705683932.476744:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.476745:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123c58a00/0xefc4487a017f6fb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cba92 expref: 3970 pid: 15130 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.476745:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476748:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045312 00010000:00010000:0.0:1705683932.476753:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.476754:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.476756:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013da expref: 5933 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476759:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.476759:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.476760:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013da expref: 5933 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.476762:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920924 00000100:00100000:1.0:1705683932.476765:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5933:6521:x1788538641045312:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.476770:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1705683932.476770:0:15128:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161090/38435 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.476772:0:15128:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff880133210a00 with x1788538641045248 ext(0->18446744073709551615) 00010000:00010000:0.0:1705683932.476774:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a741900/0xefc4487a018790cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013da expref: 5933 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.476781:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584522304:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.476796:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39840 going to sleep for 11 seconds 00002000:00010000:3.0:1705683932.476813:0:15128:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133210a00. 00000100:00100000:3.0:1705683932.476827:0:15128:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.476828:0:15128:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.476833:0:15128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150737 00000100:00100000:3.0:1705683932.476836:0:15128:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5933:1854:x1788538641045248:12345-192.168.203.41@tcp:10:dir_create.sh.0 00000100:00100000:0.0:1705683932.476840:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.476852:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476853:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476857:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045376 00000100:00100000:0.0:1705683932.476868:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476869:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.476872:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920925 00000100:00100000:0.0:1705683932.476875:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:7259:x1788538641045376:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.476938:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1705683932.476940:0:15128:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000402:0x9623:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.476942:0:15128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000402:0x9623:0x0] updating lvb mtime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.476943:0:15128:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000402:0x9623:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.476944:0:15128:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000402:0x9623:0x0] updating lvb ctime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.476945:0:15128:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000402:0x9623:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1705683932.476972:0:15128:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5934:1854:x1788538641045248:12345-192.168.203.41@tcp:10:dir_create.sh.0 Request processed in 135us (296us total) trans 4295348341 rc 0/0 00000100:00100000:3.0:1705683932.476976:0:15128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150737 00002000:00010000:3.0:1705683932.476978:0:15128:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161090/38435 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.476979:0:15128:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff880133210a00 with x1788538641045248 ext(0->18446744073709551615) 00010000:00010000:1.0:1705683932.477055:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca53700/0xefc4487a01879123 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3013fd expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.477065:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.477074:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.477075:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.477096:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca53700/0xefc4487a01879123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013fd expref: 5935 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477108:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca53700/0xefc4487a01879123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013fd expref: 5935 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477114:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca53700, rc 0) 00000100:00100000:1.0:1705683932.477131:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5935:6521:x1788538641045312:12345-192.168.203.41@tcp:101:dd.0 Request processed in 365us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.477135:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920924 00000100:00100000:1.0:1705683932.477163:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.477170:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477170:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477174:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045504 00000100:00100000:1.0:1705683932.477184:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477185:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477188:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413456 00000100:00100000:1.0:1705683932.477191:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1806:7333:x1788538641045504:12345-192.168.203.41@tcp:36:mrename.0 00010000:00010000:1.0:1705683932.477209:0:10678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1705683932.477216:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a36bc00/0xefc4487a01879107 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4091:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013ef expref: 1806 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477224:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4091:0x0].0x0 (ffff88009b857600) 00002000:00010000:3.0:1705683932.477224:0:15128:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133210a00. 00010000:00010000:0.0:1705683932.477227:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a36b480/0xefc4487a0187912a lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9647:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301404 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477231:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801314d9e00/0xefc4487a018790a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3013b0 expref: 1805 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477241:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880135adfa00) 00010000:00010000:1.0:1705683932.477243:0:10678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1705683932.477245:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9647:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.477261:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.477263:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.477266:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a36b480/0xefc4487a0187912a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301404 expref: 3971 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.477283:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a36b480/0xefc4487a0187912a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301404 expref: 3971 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.477289:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36b480, rc 0) 00010000:00010000:1.0:1705683932.477294:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.477301:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.477306:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.477310:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:7259:x1788538641045376:12345-192.168.203.41@tcp:101:dd.0 Request processed in 434us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.477314:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920925 00000100:00100000:0.0:1705683932.477362:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.477374:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.477379:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.477383:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.477390:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.477398:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.477399:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.477415:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045632 00000100:00100000:0.0:1705683932.477434:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.477435:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.477438:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920926 00000100:00100000:0.0:1705683932.477441:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3543:6496:x1788538641045632:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.477447:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.477452:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.477457:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.477458:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.477498:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.477505:0:10678:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1916 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477509:0:10678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.477521:0:10678:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1916 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477528:0:10678:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1916 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.477535:0:10678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10678:1788538584522368:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.477551:0:10678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.477560:0:14205:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477561:0:14205:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.477565:0:14205:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045760 00000100:00100000:1.0:1705683932.477579:0:14205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413457 00000100:00100000:1.0:1705683932.477582:0:14205:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1805:7365:x1788538641045760:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:1.0:1705683932.477588:0:14205:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.477589:0:14205:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1705683932.477596:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0e7aa80/0xefc4487a01879019 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41ef:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30138d expref: 1805 pid: 14377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477607:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff880135adf200) 00010000:00010000:1.0:1705683932.477612:0:14205:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.477641:0:14205:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50c80/0xefc4487a0187914d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301419 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.477665:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a36a080/0xefc4487a01879154 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30140b expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.477675:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.477683:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.477684:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.477687:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a36a080/0xefc4487a01879154 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30140b expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.477694:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a36a080/0xefc4487a01879154 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30140b expref: 3544 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.477695:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:0.0:1705683932.477699:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36a080, rc 0) 00010000:00010000:1.0:1705683932.477700:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.477705:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00000100:00100000:0.0:1705683932.477723:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:6496:x1788538641045632:12345-192.168.203.41@tcp:101:dd.0 Request processed in 281us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.477728:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920926 00010000:00010000:1.0:1705683932.477783:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31900/0xefc4487a01879162 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x41ef:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:1.0:1705683932.477788:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31900/0xefc4487a01879162 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41ef:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.477793:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31900/0xefc4487a01879162 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41ef:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00000100:00100000:0.0:1705683932.477795:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.477815:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.477815:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.477824:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045568 00000100:00100000:3.0:1705683932.477839:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.477839:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.477843:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413458 00000100:00100000:3.0:1705683932.477845:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1806:16469:x1788538641045568:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.477852:0:14233:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.477862:0:14233:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416080/0xefc4487a01879169 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x41f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301412 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.477889:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416080/0xefc4487a01879169 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x41f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301412 expref: 1807 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.477895:0:14233:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416080/0xefc4487a01879169 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x41f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301412 expref: 1807 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.477905:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41f1:0x0].0x0 (ffff8800875b2500) 00010000:00010000:3.0:1705683932.477907:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1705683932.477908:0:14233:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1416080, rc 0) 00000100:00100000:3.0:1705683932.477920:0:14233:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1807:16469:x1788538641045568:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.477924:0:14233:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413458 00000004:00080000:1.0:1705683932.477977:0:14205:0:(osp_object.c:1653:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000402:0x9cfc:0x0], index 1: 0 00010000:00010000:1.0:1705683932.478071:0:14205:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30f00/0xefc4487a01879170 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4392:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 00010000:00010000:1.0:1705683932.478094:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30f00/0xefc4487a01879170 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4392:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478100:0:14205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30f00/0xefc4487a01879170 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4392:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478122:0:14205:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478127:0:14205:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478130:0:14205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478133:0:14205:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478137:0:14205:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009ca51400 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.478139:0:14205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478142:0:14205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478148:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x0 (ffff8800a638a700) 00010000:00010000:1.0:1705683932.478150:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.478151:0:14205:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478155:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca51400/0xefc4487a0187915b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT1 00000004:00010000:1.0:1705683932.478164:0:14205:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff880090558f00 reply state ffff880134320000 transno 4295084996 ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31900/0xefc4487a01879162 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x41ef:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478170:0:14205:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31900/0xefc4487a01879162 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x41ef:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT1 00010000:00010000:1.0:1705683932.478173:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41ef:0x0].0x3231 (ffff88012d410e00) 00010000:00010000:1.0:1705683932.478175:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.478196:0:14205:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50c80/0xefc4487a0187914d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x41ef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301419 expref: 1808 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.478208:0:14205:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30f00/0xefc4487a01879170 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4392:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301419 expref: 1807 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.478213:0:14205:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4392:0x0].0x0 (ffff88009d2b7a00) 00010000:00010000:1.0:1705683932.478214:0:14205:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1705683932.478215:0:14205:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af30f00, rc 0) 00000100:00100000:1.0:1705683932.478243:0:14205:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1808:7365:x1788538641045760:12345-192.168.203.41@tcp:101:touch.0 Request processed in 660us (881us total) trans 4295084996 rc 0/0 00000100:00100000:1.0:1705683932.478250:0:14205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413457 00000100:00100000:1.0:1705683932.478417:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133213c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584522112:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.478428:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.478452:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880098452d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:1854:x1788538641044928:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2297us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.478457:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333047 00000100:00100000:0.0:1705683932.478690:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584522240:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.478696:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584522176:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.478700:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.478706:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.478737:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3467:1854:x1788538641044992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2180us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.478738:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3969:1854:x1788538641045056:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2452us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.478742:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333048 00000100:00100000:0.0:1705683932.478745:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333050 00000100:00100000:1.0:1705683932.478784:0:10678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10678:1788538584522368:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.478792:0:10678:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00100000:1.0:1705683932.478797:0:10678:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.478798:0:10678:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.478798:0:10678:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:0.0:1705683932.478801:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584522304:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.478811:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.478823:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:1854:x1788538641045120:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2118us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.478827:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333051 00000100:00100000:0.0:1705683932.478874:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.478886:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.478887:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.478894:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045888 00000100:00100000:1.0:1705683932.478906:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.478907:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.478911:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107570 00000100:00100000:1.0:1705683932.478914:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1917:7353:x1788538641045888:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1705683932.478946:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.478955:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.478956:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.478960:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641045952 00000100:00100000:0.0:1705683932.478970:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.478971:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.478975:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920927 00000100:00100000:0.0:1705683932.478977:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3544:6554:x1788538641045952:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.478984:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.478991:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1918:7353:x1788538641045888:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 75us (116us total) trans 4295084997 rc 0/0 00000100:00100000:1.0:1705683932.478999:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107570 00010000:00010000:0.0:1705683932.479015:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301420 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.479028:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3545 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.479033:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.479034:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.479035:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301420 expref: 3545 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.479048:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3545 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.479054:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3545 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.479061:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090559900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584522432:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.479116:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.479516:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.479525:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479526:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479530:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046016 00000100:00100000:3.0:1705683932.479551:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479551:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479554:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920928 00000100:00100000:3.0:1705683932.479556:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133636400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3467:6521:x1788538641046016:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.479561:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.479888:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1414a00/0xefc4487a01879185 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301427 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.479898:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.479907:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.479908:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.479911:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1414a00/0xefc4487a01879185 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301427 expref: 3468 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.479917:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1414a00/0xefc4487a01879185 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301427 expref: 3468 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.479925:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1414a00, rc 0) 00000100:00100000:3.0:1705683932.479948:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133636400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3468:6521:x1788538641046016:12345-192.168.203.41@tcp:101:dd.0 Request processed in 391us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.479951:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920928 00000100:00100000:3.0:1705683932.479974:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.479980:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479980:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479983:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046080 00000100:00100000:3.0:1705683932.479994:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479994:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.479996:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920929 00000100:00100000:3.0:1705683932.479998:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3546:7259:x1788538641046080:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.480003:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.480022:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.480034:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480036:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.480036:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480042:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046144 00000100:00100000:0.0:1705683932.480049:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.480063:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480064:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480080:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046208 00000100:00100000:1.0:1705683932.480091:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480091:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480093:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046272 00000100:00100000:1.0:1705683932.480100:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480100:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480104:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920930 00000100:00100000:1.0:1705683932.480107:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3547:16469:x1788538641046144:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.480112:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.480125:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480126:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.480130:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 2/0,0 mode: --/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301435 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.480133:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920931 00000100:00100000:0.0:1705683932.480136:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3968:4708:x1788538641046208:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.480144:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.480144:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3468 pid: 15141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480150:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.480151:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.480153:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 4/0,0 mode: --/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301435 expref: 3548 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480165:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3468 pid: 15141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480172:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3468 pid: 15141 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.480179:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584522496:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.480198:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.480208:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480209:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480213:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920932 00010000:00010000:0.0:1705683932.480216:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30143c expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.480216:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3468:16443:x1788538641046272:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.480222:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.480229:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5933 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.480234:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.480236:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.480237:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30143c expref: 3969 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.480250:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5933 pid: 15148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.480257:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5933 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.480264:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584522560:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.480294:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.480302:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1414c80/0xefc4487a0187919a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30142e expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.480310:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.480316:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.480317:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.480319:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1414c80/0xefc4487a0187919a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30142e expref: 3549 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.480324:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1414c80/0xefc4487a0187919a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30142e expref: 3549 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.480328:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1414c80, rc 0) 00000100:00100000:3.0:1705683932.480341:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:7259:x1788538641046080:12345-192.168.203.41@tcp:101:dd.0 Request processed in 342us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.480344:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920929 00000100:00100000:0.0:1705683932.480356:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.480398:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.480399:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.480402:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046336 00010000:00010000:1.0:1705683932.480408:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301443 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.480410:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.480410:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.480413:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920933 00000100:00100000:3.0:1705683932.480415:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3970:6496:x1788538641046336:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.480419:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.480422:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3548 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480426:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.480427:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.480429:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301443 expref: 3469 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480441:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3548 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.480447:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3548 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.480454:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133213c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584522624:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.480470:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.480480:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.480502:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.480512:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480513:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480514:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480515:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480518:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046528 00000100:00100000:1.0:1705683932.480522:0:6535:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046464 00000100:00100000:0.0:1705683932.480532:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480533:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480533:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480534:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480537:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920934 00000100:00100000:1.0:1705683932.480537:0:6535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107571 00000100:00100000:0.0:1705683932.480540:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3470:16415:x1788538641046528:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.480540:0:6535:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055b200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1918:16427:x1788538641046464:12345-192.168.203.41@tcp:35:dir_create.sh.0 00010000:00010000:0.0:1705683932.480546:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.480620:0:6535:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055b200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1919:16427:x1788538641046464:12345-192.168.203.41@tcp:35:dir_create.sh.0 Request processed in 80us (142us total) trans 4295084998 rc 0/0 00000100:00100000:1.0:1705683932.480625:0:6535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107571 00010000:00010000:0.0:1705683932.480706:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301451 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.480729:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3548 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.480742:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.480743:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.480745:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301451 expref: 3471 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.480759:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3548 pid: 15220 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.480765:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3548 pid: 15220 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.480766:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1417700/0xefc4487a018791af lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9210:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30144a expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.480776:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584522688:192.168.203.41@tcp:104: 00002000:00010000:3.0:1705683932.480776:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9210:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.480783:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.480784:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.480786:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1417700/0xefc4487a018791af lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30144a expref: 3971 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.480791:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1417700/0xefc4487a018791af lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30144a expref: 3971 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.480793:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.480795:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1417700, rc 0) 00000100:00100000:3.0:1705683932.480808:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:6496:x1788538641046336:12345-192.168.203.41@tcp:101:dd.0 Request processed in 393us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.480812:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920933 00000100:00100000:0.0:1705683932.480830:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.480862:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.480863:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480864:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480870:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480870:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046720 00000100:00100000:0.0:1705683932.480871:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480874:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046592 00000100:00100000:1.0:1705683932.480882:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480882:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.480884:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1920 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.480886:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107572 00000100:00100000:1.0:1705683932.480889:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1920:7353:x1788538641046720:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1705683932.480896:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480896:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480900:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333052 00000100:00100000:0.0:1705683932.480903:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1920:1857:x1788538641046592:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.480909:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.480911:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1920 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.480918:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1920 pid: 14377 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.480923:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.480927:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d2e4780/0xefc4487a01878fb0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x41a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f301347 expref: 1921 pid: 14377 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.480937:0:15209:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880135adfa00) 00010000:00010000:0.0:1705683932.480940:0:15209:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.480942:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.480948:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.480949:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1920:7353:x1788538641046720:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 58us (119us total) trans 4295084999 rc 0/0 00010000:00010000:0.0:1705683932.480952:0:15209:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.480954:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107572 00010000:00010000:0.0:1705683932.480965:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.480968:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480969:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480973:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046784 00000100:00100000:3.0:1705683932.480973:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.480981:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480982:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1919:1857:x1788538641046592:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 77us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.480982:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3549 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.480982:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480987:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333052 00000100:00100000:3.0:1705683932.480987:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046912 00000100:00100000:1.0:1705683932.480993:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480994:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480996:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.480997:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.480997:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333053 00000100:00100000:3.0:1705683932.480998:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.480998:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481000:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:1856:x1788538641046784:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.481000:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641046976 00010000:00010000:1.0:1705683932.481004:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.481008:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413459 00000100:00100000:3.0:1705683932.481012:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973c1900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1808:7365:x1788538641046912:12345-192.168.203.41@tcp:36:touch.0 00010000:00010000:1.0:1705683932.481014:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3549 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.481019:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3549 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.481030:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.481031:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.481033:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301420 expref: 3549 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.481036:0:14233:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.481038:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301420 expref: 3549 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.481048:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30f00/0xefc4487a01879170 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4392:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301419 expref: 1808 pid: 14205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.481052:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301420 expref: 3549 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.481058:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584522752:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.481059:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4392:0x0].0x0 (ffff88009d2b7a00) 00010000:00010000:3.0:1705683932.481066:0:14233:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.481094:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.481095:0:15133:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095964a00/0xefc4487a018635e6 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb22e expref: 3549 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.481105:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090559900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584522432:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.481106:0:10678:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481110:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.481118:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a369e00/0xefc4487a0187917e lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301420 expref: 3548 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.481125:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a369e00, rc 0) 00000100:00100000:0.0:1705683932.481152:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3548:6554:x1788538641045952:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2173us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.481157:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920927 00010000:00010000:1.0:1705683932.481197:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.481202:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481207:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:3.0:1705683932.481210:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414f00/0xefc4487a018791bd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4392:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:3.0:1705683932.481215:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414f00/0xefc4487a018791bd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4392:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481219:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414f00/0xefc4487a018791bd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4392:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:0.0:1705683932.481247:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.481266:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481271:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00000004:00010000:3.0:1705683932.481271:0:14233:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8800973c1900 reply state ffff88012ded4000 transno 4295085000 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414f00/0xefc4487a018791bd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4392:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:0.0:1705683932.481275:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.481275:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:3.0:1705683932.481276:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414f00/0xefc4487a018791bd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4392:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:1.0:1705683932.481278:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009af32800 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.481278:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4392:0x0].0x0 (ffff8800a0c95e00) 00010000:00010000:1.0:1705683932.481280:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:3.0:1705683932.481280:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1705683932.481283:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481284:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.481284:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.481288:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047168 00010000:00010000:1.0:1705683932.481290:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4091:0x0].0x0 (ffff88009cf21b00) 00010000:00010000:1.0:1705683932.481292:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1705683932.481293:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481296:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32800/0xefc4487a018791b6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x4091:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481308:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481308:0:14233:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c1900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1809:7365:x1788538641046912:12345-192.168.203.41@tcp:36:touch.0 Request processed in 295us (366us total) trans 4295085000 rc 0/0 00010000:00010000:1.0:1705683932.481311:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481311:0:14233:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413459 00010000:00010000:1.0:1705683932.481314:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00000100:00100000:0.0:1705683932.481316:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481317:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.481318:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009ca52d00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.481319:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481319:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.481319:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481321:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920935 00010000:00010000:1.0:1705683932.481322:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481323:0:14233:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047104 00000100:00100000:0.0:1705683932.481324:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5934:6521:x1788538641047168:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.481326:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x41a5:0x0].0x0 (ffff880135adfa00) 00010000:00010000:1.0:1705683932.481327:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1705683932.481328:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.481330:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.481331:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca52d00/0xefc4487a01879146 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x41a5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481338:0:14233:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.481339:0:14233:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.481343:0:14233:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413460 00010000:00010000:1.0:1705683932.481345:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00000100:00100000:3.0:1705683932.481346:0:14233:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1919:7362:x1788538641046976:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1705683932.481348:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481351:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:3.0:1705683932.481353:0:14233:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.481354:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009ca53200 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.481355:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481359:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481363:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff8801352f4600) 00010000:00010000:1.0:1705683932.481365:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.481366:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481369:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53200/0xefc4487a0187913f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481380:0:10678:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481383:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481385:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481388:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481391:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009ca50500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.481392:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481395:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481400:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:1.0:1705683932.481401:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.481403:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481406:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca50500/0xefc4487a01879131 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481415:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481418:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481421:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481423:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009ca53980 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.481424:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481427:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481431:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff8801352f4500) 00010000:00010000:1.0:1705683932.481432:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.481433:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.481435:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ca53980/0xefc4487a01879138 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:3.0:1705683932.481439:0:14233:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417200/0xefc4487a018791c4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301458 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.481462:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1808:7333:x1788538641045504:12345-192.168.203.41@tcp:36:mrename.0 Request processed in 4270us (4299us total) trans 0 rc -39/-39 00000100:00100000:1.0:1705683932.481467:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413456 00000100:00100000:1.0:1705683932.481477:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481478:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481481:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413461 00000100:00100000:1.0:1705683932.481485:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1846:7363:x1788538641047104:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:3.0:1705683932.481506:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:3.0:1705683932.481511:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481515:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481531:0:10678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10678:1788538584522816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1705683932.481554:0:10678:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1705683932.481564:0:10678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.481592:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481593:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481597:0:14256:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584522816 00010000:00010000:3.0:1705683932.481601:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:3.0:1705683932.481604:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481607:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481615:0:14256:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481616:0:14256:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481618:0:14256:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59906 00000100:00100000:1.0:1705683932.481621:0:14256:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:10678:x1788538584522816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1705683932.481658:0:14256:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:10678:x1788538584522816:12345-0@lo:1000:mdt00_004.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.481662:0:14256:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59906 00000100:00100000:1.0:1705683932.481683:0:10678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10678:1788538584522816:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1705683932.481721:0:14233:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:3.0:1705683932.481724:0:14233:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481727:0:14233:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481730:0:10678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10678:1788538584522880:0@lo:1000:mdt00_004.0 00000004:00200000:3.0:1705683932.481742:0:14233:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000402:0x42b3:0x0]: returning size 4096 00000004:00200000:3.0:1705683932.481744:0:14233:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1705683932.481746:0:10678:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1705683932.481751:0:14233:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481754:0:10678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.481756:0:14233:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481758:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481761:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.481761:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481762:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.481763:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481765:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1414280 already unused, calling callback (ffffffffa0d756d0) 00000100:00100000:1.0:1705683932.481766:0:8812:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538584522880 00010000:00010000:3.0:1705683932.481767:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481769:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481773:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:3.0:1705683932.481774:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.481775:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481777:0:8812:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481778:0:8812:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.481778:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1414280/0xefc4487a018791cb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00000100:00100000:1.0:1705683932.481780:0:8812:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59907 00010000:00010000:0.0:1705683932.481782:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a368000/0xefc4487a018791e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30145f expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.481783:0:8812:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:10678:x1788538584522880:12345-0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1705683932.481785:0:14233:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481787:0:14233:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481789:0:14233:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00002000:00010000:0.0:1705683932.481791:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.481791:0:14233:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a1416800 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.481792:0:14233:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481794:0:14233:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481796:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff8800a0c95c00) 00010000:00010000:3.0:1705683932.481797:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.481798:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.481798:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.481798:0:14233:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:3.0:1705683932.481799:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1416800/0xefc4487a018791d2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT1 00010000:00010000:0.0:1705683932.481800:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a368000/0xefc4487a018791e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30145f expref: 5935 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.481808:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a368000/0xefc4487a018791e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30145f expref: 5935 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.481814:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a368000, rc 0) 00010000:00010000:3.0:1705683932.481817:0:14233:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1417200/0xefc4487a018791c4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301458 expref: 1921 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.481823:0:14233:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301458 expref: 1920 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.481827:0:14233:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b3:0x0].0x0 (ffff8800a0c95500) 00010000:00010000:3.0:1705683932.481828:0:14233:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1705683932.481829:0:14233:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1415680, rc 0) 00000100:00100000:3.0:1705683932.481842:0:14233:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0e400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1920:7362:x1788538641046976:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 496us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.481845:0:14233:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413460 00000100:00100000:1.0:1705683932.481848:0:8812:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133215000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:10678:x1788538584522880:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (101us total) trans 0 rc 1/1 00000100:00100000:1.0:1705683932.481856:0:8812:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59907 00000100:00100000:1.0:1705683932.481874:0:10678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10678:1788538584522880:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1705683932.481877:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5935:6521:x1788538641047168:12345-192.168.203.41@tcp:101:dd.0 Request processed in 551us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.481882:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920935 00000100:00100000:1.0:1705683932.481905:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1846:7363:x1788538641047104:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 419us (658us total) trans 0 rc -17/-17 00000100:00100000:1.0:1705683932.481910:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413461 00000100:00100000:3.0:1705683932.481910:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.481912:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584522560:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.481918:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.481926:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30143c expref: 3970 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.481926:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481927:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481930:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047296 00000100:00100000:3.0:1705683932.481931:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.481934:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a368a00, rc 0) 00010000:00010000:1.0:1705683932.481940:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5935 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.481943:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481944:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481948:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047360 00000100:00100000:1.0:1705683932.481952:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481953:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.481956:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333054 00010000:00010000:0.0:1705683932.481958:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3472 pid: 15141 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.481959:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5935:1854:x1788538641047296:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.481964:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.481970:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.481971:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.481971:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5935 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.481975:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333055 00010000:00010000:1.0:1705683932.481976:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5935 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.481978:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:1857:x1788538641047360:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.481983:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.481983:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.481986:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3472 pid: 15141 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.481988:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c9c280/0xefc4487a01847a5b lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccc4 expref: 5935 pid: 15148 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.481990:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.481994:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3472 pid: 15141 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.481997:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.481998:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.481998:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.482000:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30143c expref: 3970 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482004:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.482005:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.482005:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30143c expref: 3970 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482008:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301435 expref: 3547 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482013:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301435 expref: 3547 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482019:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008a368a00/0xefc4487a01879193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30143c expref: 3970 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.482025:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584522944:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.482037:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301435 expref: 3547 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.482043:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.482044:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584523008:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.482052:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.482053:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482054:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482061:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047552 00010000:00010000:1.0:1705683932.482071:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3548 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.482075:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.482102:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482103:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482105:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482106:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482106:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047616 00000100:00100000:0.0:1705683932.482112:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333056 00010000:00010000:1.0:1705683932.482113:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3549 pid: 15220 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.482115:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:1856:x1788538641047552:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.482120:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.482123:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3549 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.482123:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482124:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482127:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333057 00000100:00100000:1.0:1705683932.482129:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:1856:x1788538641047616:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.482130:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3549 pid: 15095 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.482134:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.482136:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3549 pid: 15220 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.482139:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.482140:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.482142:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301443 expref: 3472 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482142:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3549 pid: 15220 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.482147:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301443 expref: 3472 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482152:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.482153:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.482155:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301451 expref: 3472 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482159:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301451 expref: 3472 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482161:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301443 expref: 3472 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.482167:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090558a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584523072:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.482172:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301451 expref: 3472 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.482179:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.482179:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584523136:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.482193:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.482197:0:15110:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b33ef80/0xefc4487a0181f7c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9cad expref: 3549 pid: 15220 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.482216:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482217:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482220:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584522688:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.482221:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047232 00010000:00010000:0.0:1705683932.482232:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a36b980/0xefc4487a018791a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301451 expref: 3472 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.482235:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.482236:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.482238:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36b980, rc 0) 00000100:00100000:1.0:1705683932.482240:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413462 00000100:00100000:1.0:1705683932.482243:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1920:7366:x1788538641047232:12345-192.168.203.41@tcp:101:lfs.0 00000100:00100000:0.0:1705683932.482249:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:16415:x1788538641046528:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1708us (1746us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.482250:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.482253:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920934 00000100:00100000:0.0:1705683932.482263:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482264:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482268:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047424 00000100:00100000:0.0:1705683932.482298:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.482300:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.482301:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.482304:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.482308:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047488 00000100:00100000:0.0:1705683932.482309:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920936 00000100:00100000:0.0:1705683932.482312:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:7259:x1788538641047424:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.482317:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af33c00/0xefc4487a018791e7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301466 expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.482322:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.482323:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.482324:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.482327:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920937 00000100:00100000:3.0:1705683932.482330:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:6496:x1788538641047488:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.482337:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.482357:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.482362:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.482366:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000004:00200000:1.0:1705683932.482381:0:10678:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x422f:0x0]: returning size 4096 00000004:00200000:1.0:1705683932.482383:0:10678:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1705683932.482390:0:10678:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.482410:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af33c00/0xefc4487a018791e7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301466 expref: 1922 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482419:0:10678:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301466 expref: 1921 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482424:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:1.0:1705683932.482425:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1705683932.482426:0:10678:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af32080, rc 0) 00000100:00100000:1.0:1705683932.482437:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7366:x1788538641047232:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 194us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.482441:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413462 00010000:00010000:1.0:1705683932.482466:0:15095:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc66800/0xefc4487a0186f769 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fe8de expref: 3471 pid: 15141 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.482477:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133213200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584522496:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.482487:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af30500/0xefc4487a0187918c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x86f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301435 expref: 3549 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482493:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af30500, rc 0) 00000100:00100000:1.0:1705683932.482504:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3549:16469:x1788538641046144:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2396us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.482508:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920930 00010000:00010000:1.0:1705683932.482528:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b1c3c00/0xefc4487a017f7429 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbde1 expref: 3548 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.482534:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133213c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584522624:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.482542:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af32a80/0xefc4487a018791a1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301443 expref: 3470 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.482546:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1414500/0xefc4487a018791f5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301474 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.482547:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af32a80, rc 0) 00000100:00100000:1.0:1705683932.482554:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3470:16443:x1788538641046272:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2337us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.482557:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920932 00002000:00010000:3.0:1705683932.482559:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.482568:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.482569:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.482573:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1414500/0xefc4487a018791f5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301474 expref: 3548 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.482582:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1414500/0xefc4487a018791f5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301474 expref: 3548 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.482588:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1414500, rc 0) 00000100:00100000:3.0:1705683932.482601:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3548:6496:x1788538641047488:12345-192.168.203.41@tcp:101:dd.0 Request processed in 270us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.482605:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920937 00010000:00010000:0.0:1705683932.482625:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a369180/0xefc4487a018791fc lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9648:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30146d expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.482635:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9648:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.482644:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.482645:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.482648:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a369180/0xefc4487a018791fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30146d expref: 3972 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482655:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a369180/0xefc4487a018791fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30146d expref: 3972 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.482661:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a369180, rc 0) 00000100:00100000:0.0:1705683932.482674:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:7259:x1788538641047424:12345-192.168.203.41@tcp:101:dd.0 Request processed in 361us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.482679:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920936 00000100:00100000:0.0:1705683932.482699:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:4708:x1788538641046208:12345-192.168.203.41@tcp:101:dd.0 Request processed in 2562us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.482702:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920931 00000100:00100000:1.0:1705683932.483333:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584522752:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.483343:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.483360:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3547:1856:x1788538641046784:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2359us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.483368:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333053 00000100:00100000:1.0:1705683932.483386:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133214100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584522944:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.483393:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.483403:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5934:1854:x1788538641047296:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1443us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.483406:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333054 00000100:00100000:1.0:1705683932.483550:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584523008:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.483560:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.483564:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090558a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584523072:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.483573:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.483575:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3469:1857:x1788538641047360:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1596us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.483579:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333055 00000100:00100000:0.0:1705683932.483596:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3546:1856:x1788538641047552:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1480us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.483602:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333056 00000100:00100000:0.0:1705683932.483796:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.483818:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.483825:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.483826:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.483830:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047680 00000100:00100000:1.0:1705683932.483830:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.483832:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.483837:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047744 00000100:00100000:0.0:1705683932.483841:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.483842:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.483845:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920938 00000100:00100000:0.0:1705683932.483849:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:6554:x1788538641047680:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.483855:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.483856:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.483858:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.483862:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920939 00000100:00100000:1.0:1705683932.483865:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3469:6521:x1788538641047744:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.483871:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.483890:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30147b expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.483900:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3972 pid: 15098 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.483906:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.483907:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.483908:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30147b expref: 3972 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.483967:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3972 pid: 15098 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.483975:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3972 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.483982:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584523200:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.484001:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.484045:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584523136:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.484054:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.484087:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3545:1856:x1788538641047616:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1939us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.484092:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333057 00010000:00010000:1.0:1705683932.484111:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af32300/0xefc4487a0187920a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301482 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.484122:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.484130:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.484131:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.484134:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af32300/0xefc4487a0187920a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301482 expref: 3470 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.484138:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.484141:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af32300/0xefc4487a0187920a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301482 expref: 3470 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.484147:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af32300, rc 0) 00000100:00100000:1.0:1705683932.484161:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3470:6521:x1788538641047744:12345-192.168.203.41@tcp:101:dd.0 Request processed in 295us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.484165:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920939 00000100:00100000:3.0:1705683932.484184:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484186:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484196:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047808 00000100:00100000:1.0:1705683932.484210:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.484218:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484219:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484224:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484224:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413463 00000100:00100000:0.0:1705683932.484225:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484225:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.484230:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055e900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1808:7365:x1788538641047808:12345-192.168.203.41@tcp:101:touch.0 00000100:00100000:1.0:1705683932.484231:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484232:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484232:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484233:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484236:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047872 00000100:00100000:0.0:1705683932.484237:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641047936 00010000:00010000:3.0:1705683932.484239:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.484249:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986a6300/0xefc4487a01879211 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x4392:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301489 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.484250:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484251:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484254:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920940 00000100:00100000:1.0:1705683932.484257:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3545:4708:x1788538641047872:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.484262:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.484264:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484265:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484269:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920941 00000100:00100000:0.0:1705683932.484272:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5934:16415:x1788538641047936:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.484279:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.484287:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800986a6300/0xefc4487a01879211 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x4392:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301489 expref: 1809 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484295:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800986a6300/0xefc4487a01879211 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x4392:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301489 expref: 1809 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484307:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4392:0x0].0x0 (ffff8800a0c95e00) 00010000:00010000:3.0:1705683932.484309:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1705683932.484311:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a6300, rc 0) 00010000:00010000:1.0:1705683932.484322:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301490 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.484334:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3469 pid: 15189 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.484337:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055e900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1809:7365:x1788538641047808:12345-192.168.203.41@tcp:101:touch.0 Request processed in 107us (199us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.484339:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.484340:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.484341:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301490 expref: 3546 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.484342:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413463 00010000:00010000:1.0:1705683932.484352:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3469 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.484359:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3469 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.484366:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584523264:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.484383:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.484389:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.484403:0:15126:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484404:0:15126:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484411:0:15126:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048000 00002000:00010000:3.0:1705683932.484425:0:15126:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419266/34546 (0->18446744073709551615) 00002000:00100000:3.0:1705683932.484427:0:15126:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f09900 with x1788538641048000 ext(0->18446744073709551615) 00002000:00010000:3.0:1705683932.484442:0:15126:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f09900. 00000100:00100000:3.0:1705683932.484453:0:15126:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484453:0:15126:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484457:0:15126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150738 00000100:00100000:3.0:1705683932.484461:0:15126:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f09900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3547:1855:x1788538641048000:12345-192.168.203.41@tcp:10:dir_create.sh.0 00000100:00100000:1.0:1705683932.484476:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.484502:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301497 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.484520:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3972 pid: 14281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.484524:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.484525:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.484526:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301497 expref: 5935 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.484539:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3972 pid: 14281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.484545:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3972 pid: 14281 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.484552:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584523328:192.168.203.41@tcp:104: 00002000:00010000:3.0:1705683932.484564:0:15126:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000402:0x86f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1705683932.484566:0:15126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000402:0x86f2:0x0] updating lvb mtime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.484567:0:15126:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000402:0x86f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1705683932.484568:0:15126:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000402:0x86f2:0x0] updating lvb ctime from disk: 1705683932 -> 1705683933 00002000:00010000:3.0:1705683932.484569:0:15126:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000402:0x86f2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.484577:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.484583:0:15126:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f09900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3548:1855:x1788538641048000:12345-192.168.203.41@tcp:10:dir_create.sh.0 Request processed in 122us (193us total) trans 4295340571 rc 0/0 00000100:00100000:3.0:1705683932.484586:0:15126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150738 00000100:00100000:0.0:1705683932.484587:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:3.0:1705683932.484587:0:15126:0:(ofd_dev.c:2709:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419266/34546 (0->18446744073709551615) 00000100:00100000:0.0:1705683932.484588:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00100000:3.0:1705683932.484588:0:15126:0:(ofd_dev.c:2453:ofd_prolong_extent_locks()) Prolong locks for req ffff880099f09900 with x1788538641048000 ext(0->18446744073709551615) 00002000:00010000:3.0:1705683932.484591:0:15126:0:(ofd_dev.c:2714:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099f09900. 00000100:00100000:0.0:1705683932.484592:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048064 00000100:00100000:3.0:1705683932.484613:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484614:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.484618:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920942 00000100:00100000:3.0:1705683932.484621:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:16443:x1788538641048064:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.484626:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.484691:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.484825:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584523200:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.484835:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30147b expref: 3972 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.484842:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36a800, rc 0) 00000100:00100000:1.0:1705683932.484858:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:6554:x1788538641047680:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1009us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.484863:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920938 00000100:00100000:1.0:1705683932.484882:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584523264:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.484891:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301490 expref: 3547 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.484898:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af31e00, rc 0) 00000100:00100000:0.0:1705683932.484909:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.484910:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3547:4708:x1788538641047872:12345-192.168.203.41@tcp:101:dd.0 Request processed in 652us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.484915:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920940 00010000:00010000:3.0:1705683932.484918:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30149e expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484935:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3971 pid: 15177 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484941:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.484942:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.484944:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30149e expref: 5937 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484961:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3971 pid: 15177 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.484967:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3971 pid: 15177 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.484973:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008187c100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584523392:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.484976:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484977:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484981:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048128 00000100:00100000:0.0:1705683932.484995:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484996:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.484998:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048256 00000100:00100000:1.0:1705683932.484998:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.484999:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485000:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.485006:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485006:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485006:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413464 00000100:00100000:1.0:1705683932.485009:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1809:7343:x1788538641048128:12345-192.168.203.41@tcp:101:mrename.0 00000100:00100000:0.0:1705683932.485010:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413465 00000100:00100000:3.0:1705683932.485012:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485013:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485014:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7366:x1788538641048256:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:1.0:1705683932.485016:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.485036:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.485072:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30280/0xefc4487a0187922d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014a5 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.485153:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:3.0:1705683932.485155:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584523328:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.485160:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485166:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:3.0:1705683932.485172:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301497 expref: 5937 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.485181:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a36a580, rc 0) 00000100:00100000:3.0:1705683932.485197:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133214100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5937:16415:x1788538641047936:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 924us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.485201:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920941 00000100:00100000:3.0:1705683932.485209:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485210:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485213:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048320 00000100:00100000:0.0:1705683932.485214:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7366:x1788538641048256:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 147us (254us total) trans 0 rc -17/-17 00000100:00100000:0.0:1705683932.485220:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413465 00000100:00100000:3.0:1705683932.485221:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485222:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485224:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920943 00000100:00100000:3.0:1705683932.485225:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:1855:x1788538641048320:12345-192.168.203.41@tcp:2:touch.0 00010000:00010000:1.0:1705683932.485236:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.485240:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485244:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.485295:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.485305:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485306:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485310:0:6531:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048448 00010000:00010000:1.0:1705683932.485320:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17ef80/0xefc4487a01879242 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00000100:00100000:0.0:1705683932.485321:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485322:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.485324:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17ef80/0xefc4487a01879242 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.485325:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413466 00000100:00100000:0.0:1705683932.485328:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7362:x1788538641048448:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:1.0:1705683932.485328:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17ef80/0xefc4487a01879242 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00010000:1.0:1705683932.485335:0:14222:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17ef80/0xefc4487a01879242 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485342:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485345:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485348:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485351:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485354:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88009af31b80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.485355:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485358:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485363:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff880083660f00) 00010000:00010000:1.0:1705683932.485364:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.485366:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485369:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af31b80/0xefc4487a01879234 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485375:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485378:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485381:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485384:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88011f17c000 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.485385:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485387:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485390:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff880135b4f500) 00010000:00010000:1.0:1705683932.485392:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.485392:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.485395:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17c000/0xefc4487a0187923b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.485403:0:6531:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055cb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7362:x1788538641048448:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 73us (109us total) trans 0 rc -17/-17 00000100:00100000:0.0:1705683932.485408:0:6531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413466 00010000:00010000:1.0:1705683932.485415:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af30280/0xefc4487a0187922d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014a5 expref: 1811 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.485422:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f17ef80/0xefc4487a01879242 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014a5 expref: 1810 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.485430:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4238:0x0].0x0 (ffff880135b4f600) 00010000:00010000:1.0:1705683932.485431:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1705683932.485432:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f17ef80, rc 0) 00000100:00100000:1.0:1705683932.485447:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1810:7343:x1788538641048128:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 437us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.485452:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413464 00000100:00100000:3.0:1705683932.485493:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:1855:x1788538641048320:12345-192.168.203.41@tcp:2:touch.0 Request processed in 265us (457us total) trans 4295348342 rc 0/0 00000100:00100000:3.0:1705683932.485497:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920943 00000100:00100000:0.0:1705683932.485505:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.485519:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485519:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485523:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048512 00000100:00100000:3.0:1705683932.485532:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920944 00000100:00100000:3.0:1705683932.485534:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:6496:x1788538641048512:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.485538:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.485603:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.485612:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485613:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485619:0:6535:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048640 00000100:00100000:0.0:1705683932.485625:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.485633:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485633:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485637:0:6535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107573 00000100:00100000:0.0:1705683932.485638:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.485640:0:6535:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c76b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1810:16469:x1788538641048640:12345-192.168.203.41@tcp:35:dir_create.sh.0 00000100:00100000:0.0:1705683932.485649:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.485656:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485657:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485661:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048832 00010000:00010000:0.0:1705683932.485670:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3470 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.485696:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485697:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485700:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048960 00010000:00010000:0.0:1705683932.485706:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3974 pid: 15177 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.485728:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485729:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485732:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333058 00000100:00100000:0.0:1705683932.485736:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3470:1854:x1788538641048832:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.485741:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.485749:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3470 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.485756:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3470 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.485773:0:6535:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c76b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1811:16469:x1788538641048640:12345-192.168.203.41@tcp:35:dir_create.sh.0 Request processed in 132us (170us total) trans 4295085001 rc 0/0 00000100:00100000:1.0:1705683932.485778:0:6535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107573 00010000:00010000:0.0:1705683932.485815:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c8ad180/0xefc4487a01847a4d lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd2 expref: 3470 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.485825:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.485827:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.485828:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301490 expref: 3546 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.485830:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485831:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.485834:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301490 expref: 3546 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.485837:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333059 00000100:00100000:1.0:1705683932.485840:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055d000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:1854:x1788538641048960:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.485846:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.485848:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3974 pid: 15177 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.485849:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009af31e00/0xefc4487a01879218 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301490 expref: 3546 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.485855:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3974 pid: 15177 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.485861:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584523456:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.485870:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.485871:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.485873:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30149e expref: 5936 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.485876:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.485878:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30149e expref: 5936 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.485892:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30149e expref: 5936 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.485899:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.485899:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584523520:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.485908:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485909:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.485910:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986a7c00/0xefc4487a01879249 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014ac expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.485913:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048896 00000100:00100000:1.0:1705683932.485915:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.485922:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3975 pid: 14281 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1705683932.485923:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9211:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.485925:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485926:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485930:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048704 00010000:00010000:3.0:1705683932.485933:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.485934:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.485938:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a7c00/0xefc4487a01879249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ac expref: 3976 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.485942:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485942:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.485946:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920945 00010000:00010000:3.0:1705683932.485946:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986a7c00/0xefc4487a01879249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ac expref: 3976 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.485950:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3547:7259:x1788538641048704:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.485953:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a7c00, rc 0) 00010000:00010000:1.0:1705683932.485954:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.485970:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:6496:x1788538641048512:12345-192.168.203.41@tcp:101:dd.0 Request processed in 434us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.485974:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.485975:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.485975:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920944 00000100:00100000:0.0:1705683932.485979:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333060 00000100:00100000:0.0:1705683932.485983:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:1857:x1788538641048896:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.485988:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.485990:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3975 pid: 14281 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.485996:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3975 pid: 14281 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.486003:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098751180/0xefc4487a017f7605 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbe82 expref: 3975 pid: 15177 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.486009:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a32db80/0xefc4487a0181fa36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9d47 expref: 3974 pid: 14281 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.486010:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008187c100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584523392:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.486017:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.486018:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.486020:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301497 expref: 5936 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.486024:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986a6080/0xefc4487a01879226 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30149e expref: 5936 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.486026:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301497 expref: 5936 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.486031:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a6080, rc 0) 00010000:00010000:0.0:1705683932.486040:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008a36a580/0xefc4487a0187921f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301497 expref: 5936 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.486045:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133213c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:16443:x1788538641048064:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1423us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.486046:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055b200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584523584:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.486050:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920942 00000100:00100000:0.0:1705683932.486064:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.486092:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.486098:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486099:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486103:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641048768 00010000:00010000:0.0:1705683932.486111:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3974 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.486122:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486123:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486126:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333061 00000100:00100000:0.0:1705683932.486129:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:1857:x1788538641048768:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.486133:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.486141:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3974 pid: 15098 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.486146:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3974 pid: 15098 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.486166:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.486176:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.486177:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.486182:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049152 00010000:00010000:1.0:1705683932.486187:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f17f200/0xefc4487a01879250 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014b3 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.486192:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.486193:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.486196:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920946 00010000:00010000:0.0:1705683932.486198:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133062f80/0xefc4487a01863610 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9520:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb243 expref: 3974 pid: 15098 timeout: 805 lvb_type: 1 00002000:00010000:1.0:1705683932.486198:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.486199:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907ae900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:6521:x1788538641049152:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.486205:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.486206:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.486207:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.486208:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.486209:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.486210:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f17f200/0xefc4487a01879250 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014b3 expref: 3548 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.486211:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30147b expref: 3973 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.486216:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30147b expref: 3973 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.486217:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f17f200/0xefc4487a01879250 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014b3 expref: 3548 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.486223:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f17f200, rc 0) 00010000:00010000:0.0:1705683932.486230:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008a36a800/0xefc4487a01879203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9520:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30147b expref: 3973 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.486236:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090559400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584523648:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.486238:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3548:7259:x1788538641048704:12345-192.168.203.41@tcp:101:dd.0 Request processed in 288us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.486243:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920945 00000100:00100000:0.0:1705683932.486251:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.486287:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.486303:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486304:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.486304:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986a7480/0xefc4487a01879257 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014c1 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.486308:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049216 00002000:00010000:3.0:1705683932.486315:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.486319:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.486324:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.486325:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.486325:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.486326:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.486328:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a7480/0xefc4487a01879257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014c1 expref: 5937 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.486330:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413467 00000100:00100000:0.0:1705683932.486331:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486332:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486332:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1922:7343:x1788538641049216:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:3.0:1705683932.486336:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986a7480/0xefc4487a01879257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014c1 expref: 5937 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.486340:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.486342:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a7480, rc 0) 00010000:00010000:1.0:1705683932.486347:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17cc80/0xefc4487a0187925e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x4238:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014c8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.486370:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907ae900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5937:6521:x1788538641049152:12345-192.168.203.41@tcp:101:dd.0 Request processed in 169us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.486375:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920946 00010000:00010000:1.0:1705683932.486379:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17fc00/0xefc4487a01879265 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.486385:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17fc00/0xefc4487a01879265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.486391:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17fc00/0xefc4487a01879265 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 00000100:00100000:1.0:1705683932.486454:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486455:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486461:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049344 00000100:00100000:1.0:1705683932.486470:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486471:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486474:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107574 00000100:00100000:1.0:1705683932.486476:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1811:7365:x1788538641049344:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:1.0:1705683932.486542:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1812:7365:x1788538641049344:12345-192.168.203.41@tcp:35:touch.0 Request processed in 64us (224us total) trans 4295085002 rc 0/0 00000100:00100000:1.0:1705683932.486546:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107574 00000004:00200000:1.0:1705683932.486559:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x200000404:0x4238:0x0]: returning size 4096 00000004:00200000:1.0:1705683932.486561:0:14222:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1705683932.486581:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17cc80/0xefc4487a0187925e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x4238:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014c8 expref: 1924 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.486588:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f17fc00/0xefc4487a01879265 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x4238:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014c8 expref: 1923 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.486592:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x4238:0x0].0x0 (ffff88009dc46900) 00010000:00010000:1.0:1705683932.486594:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1705683932.486595:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f17fc00, rc 0) 00000100:00100000:0.0:1705683932.486604:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.486605:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135576400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1923:7343:x1788538641049216:12345-192.168.203.41@tcp:101:mrename.0 Request processed in 272us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.486609:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413467 00000100:00100000:0.0:1705683932.486613:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486613:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486614:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.486615:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.486617:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049088 00000100:00100000:0.0:1705683932.486630:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413468 00000100:00100000:0.0:1705683932.486633:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1921:7368:x1788538641049088:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.486640:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.486641:0:10678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1705683932.486662:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af32080/0xefc4487a018791ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301466 expref: 1921 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.486672:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:0.0:1705683932.486675:0:10678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.486680:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a368780/0xefc4487a0187926c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014ba expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.486751:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.486758:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486763:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486778:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.486783:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486788:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486862:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.486868:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486872:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000004:00010000:0.0:1705683932.486932:0:10678:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1705683932.486935:0:10678:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb mtime from disk: 0 -> 1705683933 00000004:00010000:0.0:1705683932.486937:0:10678:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb atime from disk: 0 -> 1705683933 00000004:00010000:0.0:1705683932.486938:0:10678:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb ctime from disk: 0 -> 1705683933 00000004:00010000:0.0:1705683932.486939:0:10678:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1705683932.486942:0:10678:0:(mdt_io.c:1336:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1705683932.486945:0:10678:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486949:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486952:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486955:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486959:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008a369b80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.486961:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486965:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486970:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:0.0:1705683932.486971:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.486973:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486976:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a369b80/0xefc4487a01879273 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486983:0:10678:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486987:0:10678:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486991:0:10678:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.486994:0:10678:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff88008497bc00 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:0.0:1705683932.486995:0:10678:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.487053:0:10678:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.487060:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3231 (ffff88009dfb0d00) 00010000:00010000:0.0:1705683932.487061:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1705683932.487063:0:10678:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.487067:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008497bc00/0xefc4487a0187927a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3231 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.487113:0:10678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a368780/0xefc4487a0187926c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1923 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.487121:0:10678:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1922 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.487126:0:10678:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009cf21a00) 00010000:00010000:0.0:1705683932.487127:0:10678:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1705683932.487128:0:10678:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084978000, rc 0) 00000100:00100000:0.0:1705683932.487148:0:10678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1922:7368:x1788538641049088:12345-192.168.203.41@tcp:101:dd.0 Request processed in 513us (544us total) trans 4295085003 rc 0/0 00000100:00100000:0.0:1705683932.487162:0:10678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413468 00000100:00100000:0.0:1705683932.487873:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090559400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584523648:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.487886:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584523456:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.487899:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.487913:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3469:1854:x1788538641048832:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2177us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.487917:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333058 00010000:00010000:0.0:1705683932.487941:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.487955:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:1857:x1788538641048768:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1825us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.487959:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333061 00000100:00100000:1.0:1705683932.487969:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133216400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584523520:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.487976:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.487979:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.487985:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055d000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:1854:x1788538641048960:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2145us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.487988:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333059 00000100:00100000:0.0:1705683932.488004:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055b200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584523584:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.488010:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.488014:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.488018:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3971:1857:x1788538641048896:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2036us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.488021:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333060 00000100:00100000:3.0:1705683932.488022:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488024:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488030:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049408 00000100:00100000:1.0:1705683932.488032:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.488039:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488040:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488045:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049472 00000100:00100000:3.0:1705683932.488048:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488049:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488052:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049600 00000100:00100000:1.0:1705683932.488055:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488056:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488059:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920947 00000100:00100000:1.0:1705683932.488062:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf0500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3469:16443:x1788538641049408:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.488067:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.488069:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.488085:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488086:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488090:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488090:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920948 00000100:00100000:0.0:1705683932.488091:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.488092:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:4708:x1788538641049472:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.488097:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920949 00010000:00010000:3.0:1705683932.488099:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.488100:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133211400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3972:7259:x1788538641049600:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.488106:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.488168:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014d6 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.488177:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5936 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.488181:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.488182:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.488183:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014d6 expref: 3973 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.488195:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5936 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.488201:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5936 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.488210:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584523712:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.488236:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.488272:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014cf expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488287:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3547 pid: 14279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488292:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.488293:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.488295:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014cf expref: 3470 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488308:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3547 pid: 14279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488315:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3547 pid: 14279 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.488323:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133217800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584523776:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.488341:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.488367:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.488377:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488377:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488382:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049664 00000100:00100000:1.0:1705683932.488395:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488396:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488399:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920950 00000100:00100000:1.0:1705683932.488402:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3548:6554:x1788538641049664:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.488407:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.488408:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba6f80/0xefc4487a0187929d lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9649:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014dd expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.488417:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9649:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.488424:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.488425:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.488427:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba6f80/0xefc4487a0187929d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014dd expref: 3974 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.488436:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba6f80/0xefc4487a0187929d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014dd expref: 3974 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488438:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014eb expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.488440:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6f80, rc 0) 00010000:00010000:1.0:1705683932.488449:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3549 pid: 14398 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.488450:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133211400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:7259:x1788538641049600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 350us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.488453:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920949 00010000:00010000:1.0:1705683932.488453:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.488454:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.488455:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014eb expref: 3549 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.488463:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488464:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.488466:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3549 pid: 14398 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.488467:0:10678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049536 00010000:00010000:1.0:1705683932.488471:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3549 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.488475:0:10678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488476:0:10678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488476:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880099f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584523840:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.488478:0:10678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413469 00000100:00100000:0.0:1705683932.488479:0:10678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf5a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1812:7343:x1788538641049536:12345-192.168.203.41@tcp:101:mrename.0 00010000:00010000:0.0:1705683932.488484:0:10678:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.488489:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.488512:0:10678:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba4500/0xefc4487a018792ab lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014e4 expref: -99 pid: 10678 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.488518:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.488524:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488525:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488528:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049728 00000100:00100000:1.0:1705683932.488538:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488539:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488542:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413470 00000100:00100000:1.0:1705683932.488544:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0da00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1922:7368:x1788538641049728:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.488550:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.488556:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098294c80/0xefc4487a018792b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014f2 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488567:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098296d00/0xefc4487a018792b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.488572:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098296d00/0xefc4487a018792b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.488578:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098296d00/0xefc4487a018792b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.488625:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098294c80/0xefc4487a018792b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014f2 expref: 1924 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.488638:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098296d00/0xefc4487a018792b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x425f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014f2 expref: 1923 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.488640:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba4f00/0xefc4487a018792c0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:1.0:1705683932.488642:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009cf21a00) 00010000:00010000:1.0:1705683932.488644:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1705683932.488645:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba4f00/0xefc4487a018792c0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:1.0:1705683932.488645:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098296d00, rc 0) 00010000:00010000:0.0:1705683932.488649:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba4f00/0xefc4487a018792c0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.488661:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0da00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1923:7368:x1788538641049728:12345-192.168.203.41@tcp:101:dd.0 Request processed in 116us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.488666:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413470 00000100:00100000:1.0:1705683932.488699:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.488748:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.488761:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba7c00/0xefc4487a018792c7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.488765:0:10678:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba7c00/0xefc4487a018792c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00010000:00010000:0.0:1705683932.488769:0:10678:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba7c00/0xefc4487a018792c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.488785:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.488790:0:10678:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba6580/0xefc4487a018792ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10678 initiator: MDT0 00010000:00010000:0.0:1705683932.488794:0:10678:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15ccc80/0xefc4487a01878b18 lrc: 2/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 00000100:00100000:1.0:1705683932.488794:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488795:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.488796:0:10678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba6580/0xefc4487a018792ce lrc: 4/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10678 initiator: MDT1 00000100:00100000:1.0:1705683932.488799:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049984 00010000:00010000:0.0:1705683932.488801:0:10678:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800a15ccc80/0xefc4487a01878b18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 00010000:00010000:0.0:1705683932.488805:0:10678:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099ba6580/0xefc4487a018792ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10678 initiator: MDT1 00010000:00100000:0.0:1705683932.488808:0:10678:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.488808:0:10678:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:0.0:1705683932.488809:0:10678:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488811:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488812:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488815:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413471 00000100:00100000:1.0:1705683932.488817:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055b200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1923:7369:x1788538641049984:12345-192.168.203.41@tcp:36:mkdir.0 00000100:00100000:0.0:1705683932.488818:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488819:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488822:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049792 00000100:00100000:0.0:1705683932.488830:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488831:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488832:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641049856 00000100:00100000:0.0:1705683932.488837:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488838:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.488840:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920951 00000100:00100000:0.0:1705683932.488842:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3550:6496:x1788538641049792:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.488847:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.488866:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055b200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1923:7369:x1788538641049984:12345-192.168.203.41@tcp:36:mkdir.0 Request processed in 47us (82us total) trans 0 rc -17/-17 00000100:00100000:1.0:1705683932.488871:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413471 00000100:00100000:1.0:1705683932.488885:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488886:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.488891:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920952 00000100:00100000:1.0:1705683932.488893:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f0ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3471:16415:x1788538641049856:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.488899:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.488990:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301500 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489002:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3550 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489007:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.489008:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.489009:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301500 expref: 3472 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489021:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3550 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489027:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3550 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.489033:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584523904:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.489048:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.489068:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.489105:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.489106:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.489111:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050048 00000100:00100000:1.0:1705683932.489123:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.489127:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.489128:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.489131:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920953 00000100:00100000:3.0:1705683932.489134:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3473:6521:x1788538641050048:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.489139:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.489179:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.489188:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489189:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489193:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050240 00010000:00010000:0.0:1705683932.489198:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba5680/0xefc4487a018792dc lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3014f9 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.489204:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489204:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:0.0:1705683932.489205:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.489207:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413472 00000100:00100000:1.0:1705683932.489211:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1923:7368:x1788538641050240:12345-192.168.203.41@tcp:36:dd.0 00010000:00010000:0.0:1705683932.489212:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489213:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489215:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba5680/0xefc4487a018792dc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014f9 expref: 3551 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489221:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba5680/0xefc4487a018792dc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014f9 expref: 3551 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489224:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba5680, rc 0) 00000100:00100000:0.0:1705683932.489235:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:6496:x1788538641049792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 392us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.489238:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920951 00000100:00100000:0.0:1705683932.489247:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489248:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489250:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050112 00010000:00010000:0.0:1705683932.489255:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5937 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.489262:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489263:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489264:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333062 00000100:00100000:0.0:1705683932.489266:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5937:1856:x1788538641050112:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.489269:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.489275:0:14222:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1923 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489279:0:14222:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.489290:0:14222:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1923 pid: 10678 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489294:0:14222:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1923 pid: 10678 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.489299:0:14222:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:14222:1788538584523968:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.489315:0:14222:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bdd80 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.489328:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.489334:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5937 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.489339:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5937 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.489348:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489348:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489350:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014d6 expref: 3973 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489353:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014d6 expref: 3973 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489362:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014d6 expref: 3973 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.489366:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584524032:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.489373:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986a4280/0xefc4487a018792ea lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301507 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.489379:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00002000:00010000:3.0:1705683932.489385:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.489392:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.489393:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.489397:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986a4280/0xefc4487a018792ea lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301507 expref: 3474 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.489403:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986a4280/0xefc4487a018792ea lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301507 expref: 3474 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.489407:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a4280, rc 0) 00000100:00100000:1.0:1705683932.489412:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133217800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584523776:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.489422:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014cf expref: 3474 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.489423:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3474:6521:x1788538641050048:12345-192.168.203.41@tcp:101:dd.0 Request processed in 289us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.489426:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920953 00010000:00010000:1.0:1705683932.489430:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f17d900, rc 0) 00000100:00100000:1.0:1705683932.489444:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf0500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3473:16443:x1788538641049408:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1381us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.489449:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.489450:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d562580/0xefc4487a01847a69 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccd9 expref: 5937 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.489452:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920947 00000100:00100000:1.0:1705683932.489460:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489460:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489463:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050304 00000100:00100000:3.0:1705683932.489471:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584523712:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.489479:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.489480:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.489483:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986a7980/0xefc4487a0187928f lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014d6 expref: 3973 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.489484:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920954 00010000:00010000:3.0:1705683932.489486:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986a7980, rc 0) 00000100:00100000:1.0:1705683932.489487:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:7259:x1788538641050304:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.489491:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.489495:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133216400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:4708:x1788538641049472:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1402us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.489498:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920948 00000100:00100000:0.0:1705683932.489552:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.489561:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489562:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489567:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050368 00010000:00010000:0.0:1705683932.489575:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3552 pid: 14279 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.489585:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489586:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.489589:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333063 00000100:00100000:0.0:1705683932.489592:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2c100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:1857:x1788538641050368:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.489597:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.489599:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3552 pid: 14279 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.489604:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3552 pid: 14279 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.489613:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133062300/0xefc4487a017f77cc lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbecf expref: 3552 pid: 14279 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.489620:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489621:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.489622:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014cf expref: 3472 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489627:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014cf expref: 3472 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.489640:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f17d900/0xefc4487a01879296 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014cf expref: 3472 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.489646:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa2d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584524096:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.489662:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.489684:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c39cf00/0xefc4487a018792f1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30150e expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.489694:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.489701:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.489702:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.489704:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c39cf00/0xefc4487a018792f1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30150e expref: 3552 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489726:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c39cf00/0xefc4487a018792f1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30150e expref: 3552 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489732:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c39cf00, rc 0) 00000100:00100000:1.0:1705683932.489745:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:7259:x1788538641050304:12345-192.168.203.41@tcp:101:dd.0 Request processed in 257us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.489749:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920954 00000100:00100000:1.0:1705683932.489805:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880099f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584523840:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.489816:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014eb expref: 3551 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.489823:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098296580, rc 0) 00000100:00100000:1.0:1705683932.489834:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:6554:x1788538641049664:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1431us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.489838:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920950 00000100:00100000:0.0:1705683932.489944:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584523904:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.489947:0:14222:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0001_UUID:14222:1788538584523968:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.489956:0:14222:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00100000:1.0:1705683932.489960:0:14222:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.489961:0:14222:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:1.0:1705683932.489961:0:14222:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00010000:00010000:0.0:1705683932.490041:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301500 expref: 3472 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.490044:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.490049:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098295400, rc 0) 00000100:00100000:1.0:1705683932.490052:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490053:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490057:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050496 00000100:00100000:0.0:1705683932.490067:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f0ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:16415:x1788538641049856:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1172us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.490067:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490068:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490070:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920955 00000100:00100000:1.0:1705683932.490073:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3973:6496:x1788538641050496:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.490095:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920952 00010000:00010000:1.0:1705683932.490103:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.490119:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf4b00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584524032:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.490127:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.490139:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:1856:x1788538641050112:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 872us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.490144:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333062 00000100:00100000:0.0:1705683932.490193:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.490221:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.490222:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.490231:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050432 00000100:00100000:3.0:1705683932.490250:0:6531:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.490251:0:6531:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.490256:0:6531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413473 00000100:00100000:3.0:1705683932.490259:0:6531:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1924:7369:x1788538641050432:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:3.0:1705683932.490267:0:6531:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.490340:0:6531:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800986a5180/0xefc4487a018792f8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30151c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.490385:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9e300/0xefc4487a018792ff lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301515 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.490394:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9212:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.490401:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.490402:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.490405:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9e300/0xefc4487a018792ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301515 expref: 3974 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.490407:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a287480/0xefc4487a01879306 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.490414:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a287480/0xefc4487a01879306 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.490417:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9e300/0xefc4487a018792ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301515 expref: 3974 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.490418:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a287480/0xefc4487a01879306 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00010000:1.0:1705683932.490422:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9e300, rc 0) 00010000:00010000:3.0:1705683932.490423:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a284a00/0xefc4487a0187930d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.490426:0:6531:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a284a00/0xefc4487a0187930d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.490428:0:6531:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a284a00/0xefc4487a0187930d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00000100:00100000:1.0:1705683932.490445:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:6496:x1788538641050496:12345-192.168.203.41@tcp:101:dd.0 Request processed in 370us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.490449:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920955 00010000:00010000:3.0:1705683932.490471:0:6531:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098414a00/0xefc4487a01879314 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 00010000:00010000:3.0:1705683932.490477:0:6531:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098414a00/0xefc4487a01879314 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 00010000:00010000:3.0:1705683932.490484:0:6531:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880098414a00/0xefc4487a01879314 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x42b2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 00010000:00100000:3.0:1705683932.490488:0:6531:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.490489:0:6531:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.490490:0:6531:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490537:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.490548:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.490549:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490550:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.490554:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050752 00000100:00100000:1.0:1705683932.490556:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490557:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490561:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050816 00000100:00100000:0.0:1705683932.490567:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.490568:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.490572:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920956 00000100:00100000:1.0:1705683932.490572:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.490573:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.490574:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:4708:x1788538641050752:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.490576:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920957 00000100:00100000:1.0:1705683932.490579:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5936:6521:x1788538641050816:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.490580:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.490584:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.490639:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301523 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.490651:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3471 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.490660:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.490661:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.490663:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301523 expref: 3552 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.490675:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3471 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.490681:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3471 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.490687:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa2ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584524160:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.490704:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.490886:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9de00/0xefc4487a01879322 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30152a expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.490895:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.490903:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.490904:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.490907:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9de00/0xefc4487a01879322 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30152a expref: 5937 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.490913:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9de00/0xefc4487a01879322 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30152a expref: 5937 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.490919:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9de00, rc 0) 00000100:00100000:1.0:1705683932.490933:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5937:6521:x1788538641050816:12345-192.168.203.41@tcp:101:dd.0 Request processed in 353us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.490937:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920957 00000100:00100000:1.0:1705683932.490985:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.490986:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa2d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584524096:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.490999:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.491013:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2c100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:1857:x1788538641050368:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1420us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.491018:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333063 00000100:00100000:1.0:1705683932.491022:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.491026:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491027:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491030:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050560 00010000:00010000:0.0:1705683932.491038:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3552 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.491043:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.491050:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491051:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491051:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491052:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491055:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050624 00010000:00010000:1.0:1705683932.491062:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3553 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.491086:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491087:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491090:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333064 00000100:00100000:1.0:1705683932.491093:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:1856:x1788538641050560:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.491098:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.491107:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.491113:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.491116:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050688 00010000:00010000:1.0:1705683932.491123:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9b80/0xefc4487a01863609 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb24a expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.491127:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1926 pid: 10678 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.491135:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.491136:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.491138:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014eb expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.491140:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491141:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.491143:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014eb expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.491145:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333065 00000100:00100000:0.0:1705683932.491148:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:1856:x1788538641050624:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.491153:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.491155:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3552 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.491156:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098296580/0xefc4487a018792a4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014eb expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.491161:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3552 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.491163:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584524224:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.491171:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081bf5b80/0xefc4487a0181fdcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9e35 expref: 3552 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.491178:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.491179:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.491181:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301500 expref: 3471 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.491182:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bdd80 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.491186:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301500 expref: 3471 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.491190:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491191:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491195:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333066 00010000:00010000:0.0:1705683932.491199:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098295400/0xefc4487a018792d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301500 expref: 3471 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.491199:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1926:1856:x1788538641050688:12345-192.168.203.41@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1705683932.491206:0:6519:0:(ldlm_lockd.c:1696:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1926 pid: 10678 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.491211:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa2d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584524288:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.491212:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1926 pid: 10678 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.491217:0:6519:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1926 pid: 10678 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.491226:0:6519:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009cf21a00) 00000100:00100000:0.0:1705683932.491228:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c396c0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.491228:0:6519:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1705683932.491229:0:6519:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491234:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491237:0:6519:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491248:0:6519:0:(ldlm_lockd.c:1744:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880084978000/0xefc4487a01879281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3014ba expref: 1926 pid: 10678 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.491268:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.491278:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1926:1856:x1788538641050688:12345-192.168.203.41@tcp:102:ldlm_bl.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.491283:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333066 00000100:00100000:0.0:1705683932.491297:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.491298:0:14222:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491303:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.491332:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.491341:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491342:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000004:00010000:1.0:1705683932.491369:0:14222:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1705683932.491371:0:14222:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb mtime from disk: 1705683933 -> 1705683933 00000004:00010000:1.0:1705683932.491372:0:14222:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb atime from disk: 1705683933 -> 1705683933 00000004:00010000:1.0:1705683932.491374:0:14222:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb ctime from disk: 1705683933 -> 1705683933 00000004:00010000:1.0:1705683932.491375:0:14222:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1705683932.491378:0:14222:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff8800a5b20f00 reply state ffff8801331d0000 transno 4295085004 ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491385:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098297480/0xefc4487a018792e3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x425f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.491389:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x425f:0x0].0x0 (ffff88009cf21a00) 00010000:00010000:1.0:1705683932.491390:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1705683932.491425:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1927:7368:x1788538641050240:12345-192.168.203.41@tcp:36:dd.0 Request processed in 2213us (2246us total) trans 4295085004 rc 0/0 00000100:00100000:1.0:1705683932.491430:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413472 00000100:00100000:1.0:1705683932.491445:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491446:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491450:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050944 00000100:00100000:1.0:1705683932.491469:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491469:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491471:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051008 00000100:00100000:1.0:1705683932.491480:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491481:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491483:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920958 00000100:00100000:1.0:1705683932.491486:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5937:16443:x1788538641050944:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.491491:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.491492:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491494:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491501:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920959 00000100:00100000:3.0:1705683932.491506:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:6496:x1788538641051008:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.491514:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.491579:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301538 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491592:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3973 pid: 15162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491596:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.491597:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.491598:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301538 expref: 5938 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.491607:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641050880 00010000:00010000:1.0:1705683932.491614:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3974 pid: 15162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491620:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3974 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.491626:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cb700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584524352:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.491641:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.491689:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.491690:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491691:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491696:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920960 00000100:00100000:1.0:1705683932.491697:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491697:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.491700:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009851f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3974:7259:x1788538641050880:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.491701:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051072 00010000:00010000:0.0:1705683932.491706:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.491723:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3472 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.491733:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491734:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.491737:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333067 00000100:00100000:1.0:1705683932.491739:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:1854:x1788538641051072:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.491744:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.491745:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098417480/0xefc4487a01879330 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30153f expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491751:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3472 pid: 15115 timeout: 805 lvb_type: 1 00002000:00010000:3.0:1705683932.491756:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.491757:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3472 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.491764:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.491765:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.491768:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098417480/0xefc4487a01879330 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30153f expref: 3553 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491772:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.491773:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.491774:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098417480/0xefc4487a01879330 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30153f expref: 3553 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491775:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301523 expref: 3553 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.491778:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098417480, rc 0) 00010000:00010000:1.0:1705683932.491780:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301523 expref: 3553 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.491794:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301523 expref: 3553 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.491798:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:6496:x1788538641051008:12345-192.168.203.41@tcp:101:dd.0 Request processed in 293us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.491800:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584524416:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.491803:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920959 00000100:00100000:1.0:1705683932.491819:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.491847:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.491849:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c9ea80/0xefc4487a01847a70 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce0 expref: 3472 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.491862:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa2ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584524160:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.491874:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584524224:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.491885:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.491885:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba4c80/0xefc4487a0187931b lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301523 expref: 3552 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.491892:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba4c80, rc 0) 00000100:00100000:1.0:1705683932.491896:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:1856:x1788538641050560:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 802us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.491901:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333064 00000100:00100000:3.0:1705683932.491906:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:4708:x1788538641050752:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1332us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.491910:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920956 00000100:00100000:3.0:1705683932.491920:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491921:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491925:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051136 00000100:00100000:3.0:1705683932.491938:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491939:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.491942:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920961 00000100:00100000:3.0:1705683932.491945:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:6521:x1788538641051136:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.491951:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.492005:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.492015:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492016:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492021:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051200 00000100:00100000:1.0:1705683932.492033:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492034:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492036:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920962 00000100:00100000:1.0:1705683932.492039:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:6554:x1788538641051200:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.492045:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.492094:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30154d expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.492104:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa2d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584524288:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.492105:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3976 pid: 15217 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.492109:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.492109:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.492110:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30154d expref: 3976 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.492116:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.492121:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3976 pid: 15217 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.492126:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3976 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.492129:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3550:1856:x1788538641050624:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 980us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.492132:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584524480:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.492134:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333065 00000100:00100000:1.0:1705683932.492143:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.492152:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba7480/0xefc4487a0187933e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301531 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.492162:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.492170:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.492171:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.492174:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba7480/0xefc4487a0187933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301531 expref: 3977 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.492186:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba7480/0xefc4487a0187933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301531 expref: 3977 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.492191:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba7480, rc 0) 00010000:00010000:3.0:1705683932.492245:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098416d00/0xefc4487a01879345 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301546 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.492256:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.492258:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009851f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3977:7259:x1788538641050880:12345-192.168.203.41@tcp:101:dd.0 Request processed in 557us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.492263:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920960 00010000:00010000:3.0:1705683932.492264:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.492265:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.492267:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098416d00/0xefc4487a01879345 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301546 expref: 3473 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492272:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098416d00/0xefc4487a01879345 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301546 expref: 3473 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492277:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098416d00, rc 0) 00000100:00100000:3.0:1705683932.492287:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3473:6521:x1788538641051136:12345-192.168.203.41@tcp:101:dd.0 Request processed in 341us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.492290:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920961 00000100:00100000:1.0:1705683932.492310:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.492326:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.492327:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.492330:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051264 00000100:00100000:3.0:1705683932.492338:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.492339:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.492341:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920963 00000100:00100000:3.0:1705683932.492343:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5939:16415:x1788538641051264:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.492348:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.492673:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301554 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492688:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3976 pid: 15098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492694:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.492695:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.492696:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301554 expref: 5940 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492727:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3976 pid: 15098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.492736:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3976 pid: 15098 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.492743:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584524544:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.492775:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.492912:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.492938:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492939:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492944:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051392 00000100:00100000:1.0:1705683932.492966:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492967:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.492971:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413474 00000100:00100000:1.0:1705683932.492974:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1927:7371:x1788538641051392:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:1.0:1705683932.492982:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.492983:0:14222:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1705683932.492992:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a1415680/0xefc4487a018791d9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x42b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301458 expref: 1927 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493002:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b3:0x0].0x0 (ffff8800a0c95500) 00010000:00010000:1.0:1705683932.493010:0:14222:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.493123:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584524416:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.493127:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.493130:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.493140:0:6546:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.493141:0:6546:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493143:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:1854:x1788538641051072:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1404us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.493147:0:6546:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051456 00000100:00100000:1.0:1705683932.493148:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333067 00002000:00010000:0.0:1705683932.493160:0:6546:0:(mdt_io.c:316:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000404:0x425f:0x0] 00002000:00100000:0.0:1705683932.493162:0:6546:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff88008fa2d000 with x1788538641051456 00000100:00100000:1.0:1705683932.493163:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584524480:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.493171:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30154d expref: 3976 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493178:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9db80, rc 0) 00000100:00100000:0.0:1705683932.493184:0:6546:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.493185:0:6546:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493187:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:6554:x1788538641051200:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1147us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.493189:0:6546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 654 00000100:00100000:1.0:1705683932.493191:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920962 00000100:00100000:0.0:1705683932.493192:0:6546:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1927:1854:x1788538641051456:12345-192.168.203.41@tcp:10:dd.0 00010000:00010000:1.0:1705683932.493201:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9cc80/0xefc4487a01879353 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30155b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493259:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.493264:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.493269:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.493338:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e580/0xefc4487a01879361 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x42b3:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.493343:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e580/0xefc4487a01879361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b3:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.493347:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e580/0xefc4487a01879361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b3:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00010000:0.0:1705683932.493406:0:6546:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1705683932.493409:0:6546:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb mtime from disk: 1705683933 -> 1705683933 00000004:00010000:0.0:1705683932.493410:0:6546:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb atime from disk: 1705683933 -> 1705683933 00000004:00010000:0.0:1705683932.493412:0:6546:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb ctime from disk: 1705683933 -> 1705683933 00000004:00010000:0.0:1705683932.493413:0:6546:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240000404:0x425f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1705683932.493432:0:6546:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2d000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1929:1854:x1788538641051456:12345-192.168.203.41@tcp:10:dd.0 Request processed in 238us (305us total) trans 4295085005 rc 0/0 00000100:00100000:0.0:1705683932.493440:0:6546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 654 00002000:00010000:0.0:1705683932.493442:0:6546:0:(mdt_io.c:316:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000404:0x425f:0x0] 00002000:00100000:0.0:1705683932.493443:0:6546:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff88008fa2d000 with x1788538641051456 00000100:00100000:0.0:1705683932.493469:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.493527:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584524544:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.493539:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301554 expref: 5940 pid: 15135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1705683932.493545:0:14222:0:(osp_object.c:1653:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000402:0x8dbd:0x0], index 0: 0 00010000:00010000:3.0:1705683932.493546:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098415400, rc 0) 00000100:00100000:3.0:1705683932.493561:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:16415:x1788538641051264:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1217us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.493562:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.493565:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920963 00000100:00100000:3.0:1705683932.493571:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493572:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493575:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051520 00000100:00100000:1.0:1705683932.493577:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493578:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493583:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051584 00000100:00100000:3.0:1705683932.493585:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493586:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493588:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920964 00010000:00010000:1.0:1705683932.493593:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3977 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.493593:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3977:6496:x1788538641051520:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.493594:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.493599:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.493604:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.493604:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493605:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493605:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493607:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051648 00000100:00100000:0.0:1705683932.493610:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333068 00010000:00010000:1.0:1705683932.493613:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3978 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.493614:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1857:x1788538641051584:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.493620:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.493620:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493621:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.493623:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3978 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.493623:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333069 00000100:00100000:1.0:1705683932.493626:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1857:x1788538641051648:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.493630:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3978 pid: 15162 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.493631:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.493638:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3978 pid: 15217 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.493643:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.493644:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.493644:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3978 pid: 15217 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.493646:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301538 expref: 5939 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.493651:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301538 expref: 5939 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493655:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9e00/0xefc4487a0186362c lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9521:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb251 expref: 3978 pid: 15217 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.493661:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.493662:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.493664:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30154d expref: 3977 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.493666:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301538 expref: 5939 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493669:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30154d expref: 3977 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.493678:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa2ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584524608:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.493683:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131f9db80/0xefc4487a01879337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9521:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30154d expref: 3977 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.493689:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584524672:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.493695:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.493705:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.493742:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.493764:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.493776:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493777:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493781:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051776 00010000:00010000:1.0:1705683932.493790:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3978 pid: 15098 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.493800:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493802:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493804:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333070 00000100:00100000:1.0:1705683932.493807:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2c600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1856:x1788538641051776:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.493812:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.493813:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3978 pid: 15098 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.493819:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3978 pid: 15098 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.493829:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.493829:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64c5e00/0xefc4487a018200b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9eeb expref: 3978 pid: 15098 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.493835:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.493836:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.493837:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.493838:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.493838:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301554 expref: 5939 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.493842:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051712 00010000:00010000:1.0:1705683932.493842:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301554 expref: 5939 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.493855:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098415400/0xefc4487a0187934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301554 expref: 5939 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.493861:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493861:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584524736:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.493879:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.493888:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493889:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493893:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051840 00000100:00100000:1.0:1705683932.493904:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493904:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.493908:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920965 00000100:00100000:1.0:1705683932.493910:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:4708:x1788538641051712:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.493912:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493914:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.493915:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.493916:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.493918:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920966 00000100:00100000:0.0:1705683932.493922:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3550:7259:x1788538641051840:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.493929:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.493931:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098417200/0xefc4487a01879368 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9213:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301562 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.493940:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9213:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.493948:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.493949:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.493952:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098417200/0xefc4487a01879368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301562 expref: 3979 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.493957:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098417200/0xefc4487a01879368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301562 expref: 3979 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.493961:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098417200, rc 0) 00000100:00100000:3.0:1705683932.493972:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:6496:x1788538641051520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 380us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.493975:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920964 00010000:00010000:1.0:1705683932.493990:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301569 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.494002:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5939 pid: 15108 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.494007:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.494007:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.494009:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301569 expref: 3979 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.494021:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5939 pid: 15108 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.494027:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5939 pid: 15108 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.494033:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584524800:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.494051:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.494151:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba5900/0xefc4487a01879376 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301570 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.494158:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e080/0xefc4487a0187937d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4265:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00002000:00010000:0.0:1705683932.494162:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.494167:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e080/0xefc4487a0187937d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4265:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.494170:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.494171:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.494172:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e080/0xefc4487a0187937d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4265:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:0.0:1705683932.494174:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba5900/0xefc4487a01879376 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301570 expref: 3551 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494181:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba5900/0xefc4487a01879376 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301570 expref: 3551 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494187:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba5900, rc 0) 00010000:00010000:1.0:1705683932.494198:0:14222:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.494201:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:7259:x1788538641051840:12345-192.168.203.41@tcp:101:dd.0 Request processed in 279us (373us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.494203:0:14222:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.494206:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920966 00010000:00010000:1.0:1705683932.494207:0:14222:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494210:0:14222:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494214:0:14222:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880131f9c500 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:1.0:1705683932.494216:0:14222:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494220:0:14222:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494224:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b3:0x0].0x0 (ffff880094c69800) 00010000:00010000:1.0:1705683932.494226:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1705683932.494227:0:14222:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494230:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9c500/0xefc4487a0187935a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT1 00000004:00010000:1.0:1705683932.494238:0:14222:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88008fa28f00 reply state ffff880124c10000 transno 4295085006 ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e580/0xefc4487a01879361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x42b3:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000100:00100000:0.0:1705683932.494240:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.494244:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e580/0xefc4487a01879361 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x42b3:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.494247:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x42b3:0x0].0x30 (ffff880094c69a00) 00010000:00010000:1.0:1705683932.494248:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1705683932.494249:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494250:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494253:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641051904 00010000:00010000:1.0:1705683932.494269:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9cc80/0xefc4487a01879353 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x42b3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30155b expref: 1930 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.494271:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494272:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494275:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920967 00000100:00100000:0.0:1705683932.494278:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:6521:x1788538641051904:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.494279:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e080/0xefc4487a0187937d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4265:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30155b expref: 1929 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.494283:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4265:0x0].0x0 (ffff880094c69500) 00010000:00010000:0.0:1705683932.494284:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.494284:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1705683932.494285:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9e080, rc 0) 00000100:00100000:1.0:1705683932.494300:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1930:7371:x1788538641051392:12345-192.168.203.41@tcp:101:touch.0 Request processed in 1325us (1390us total) trans 4295085006 rc 0/0 00000100:00100000:1.0:1705683932.494305:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413474 00010000:00010000:1.0:1705683932.494329:0:15110:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cbd680/0xefc4487a017f7915 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf4d expref: 3979 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.494337:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cb700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584524352:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.494346:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9f700/0xefc4487a01879329 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301538 expref: 5940 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.494351:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9f700, rc 0) 00000100:00100000:1.0:1705683932.494361:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:16443:x1788538641050944:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2875us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.494366:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920958 00010000:00010000:0.0:1705683932.494515:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba4780/0xefc4487a0187938b lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301577 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.494524:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.494532:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.494533:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.494535:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba4780/0xefc4487a0187938b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301577 expref: 5940 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494542:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba4780/0xefc4487a0187938b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301577 expref: 5940 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494548:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba4780, rc 0) 00000100:00100000:0.0:1705683932.494561:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:6521:x1788538641051904:12345-192.168.203.41@tcp:101:dd.0 Request processed in 282us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.494565:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920967 00000100:00100000:0.0:1705683932.494686:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa2ee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584524608:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.494693:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584524672:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.494700:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.494701:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.494721:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1857:x1788538641051648:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1094us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.494726:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333069 00000100:00100000:0.0:1705683932.494729:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1857:x1788538641051584:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1113us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.494734:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333068 00000100:00100000:1.0:1705683932.494752:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.494761:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.494762:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.494769:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052032 00000100:00100000:1.0:1705683932.494788:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.494789:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.494792:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107575 00000100:00100000:1.0:1705683932.494795:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1930:7368:x1788538641052032:12345-192.168.203.41@tcp:35:dd.0 00000100:00100000:0.0:1705683932.494804:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.494817:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494818:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494823:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052096 00000100:00100000:0.0:1705683932.494835:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494836:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.494839:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920968 00000100:00100000:0.0:1705683932.494841:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3551:6554:x1788538641052096:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.494847:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.494852:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1931:7368:x1788538641052032:12345-192.168.203.41@tcp:35:dd.0 Request processed in 56us (100us total) trans 4295085007 rc 0/0 00000100:00100000:1.0:1705683932.494856:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107575 00010000:00010000:0.0:1705683932.494866:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30157e expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494878:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3552 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.494883:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.494884:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.494885:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30157e expref: 3552 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.494897:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3552 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.494903:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3552 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.494910:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa2cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584524864:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.494926:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.495242:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.495250:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495251:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495256:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052224 00000100:00100000:1.0:1705683932.495277:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495278:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495282:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413475 00000100:00100000:1.0:1705683932.495285:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2e400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1931:7371:x1788538641052224:12345-192.168.203.41@tcp:36:touch.0 00010000:00010000:1.0:1705683932.495301:0:14222:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.495307:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e080/0xefc4487a0187937d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4265:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30155b expref: 1931 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.495318:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4265:0x0].0x0 (ffff880094c69500) 00010000:00010000:1.0:1705683932.495322:0:14222:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.495381:0:14222:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e800/0xefc4487a01879399 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x4265:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 00010000:00010000:1.0:1705683932.495386:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e800/0xefc4487a01879399 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.495391:0:14222:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e800/0xefc4487a01879399 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00000004:00010000:1.0:1705683932.495422:0:14222:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88008fa2e400 reply state ffff8801331d1000 transno 4295085008 ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e800/0xefc4487a01879399 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.495428:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131f9e800/0xefc4487a01879399 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x4265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT1 00010000:00010000:1.0:1705683932.495432:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4265:0x0].0x0 (ffff880131598500) 00010000:00010000:1.0:1705683932.495433:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1705683932.495459:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2e400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1932:7371:x1788538641052224:12345-192.168.203.41@tcp:36:touch.0 Request processed in 173us (219us total) trans 4295085008 rc 0/0 00000100:00100000:1.0:1705683932.495463:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413475 00000100:00100000:0.0:1705683932.495633:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.495641:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495642:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.495647:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.495647:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052416 00000100:00100000:1.0:1705683932.495664:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495665:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495667:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052480 00000100:00100000:1.0:1705683932.495686:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584524736:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.495695:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.495725:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2c600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:1856:x1788538641051776:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1916us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.495726:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.495728:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495729:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333070 00000100:00100000:3.0:1705683932.495737:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920969 00000100:00100000:3.0:1705683932.495741:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3472:16443:x1788538641052416:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.495742:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495743:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495747:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920970 00010000:00010000:3.0:1705683932.495748:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.495750:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:6496:x1788538641052480:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.495766:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584524800:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.495778:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301569 expref: 3975 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.495786:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9d400, rc 0) 00000100:00100000:1.0:1705683932.495803:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:4708:x1788538641051712:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1891us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.495805:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.495807:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920965 00000100:00100000:1.0:1705683932.495815:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495816:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495819:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052544 00000100:00100000:1.0:1705683932.495828:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495829:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.495832:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920971 00000100:00100000:1.0:1705683932.495834:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3975:7259:x1788538641052544:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.495839:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.495942:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30158c expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.495958:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3553 pid: 15170 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.495964:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.495965:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.495967:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30158c expref: 3473 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.495982:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3553 pid: 15170 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.495994:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3553 pid: 15170 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.496002:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584524928:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.496009:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.496026:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.496134:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131f9d680/0xefc4487a018793a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30159a expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.496144:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.496144:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496145:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496151:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052608 00010000:00010000:1.0:1705683932.496154:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496155:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496158:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9d680/0xefc4487a018793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30159a expref: 3976 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.496163:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.496164:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131f9d680/0xefc4487a018793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30159a expref: 3976 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.496164:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496167:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413476 00010000:00010000:1.0:1705683932.496169:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9d680, rc 0) 00000100:00100000:3.0:1705683932.496169:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1932:7371:x1788538641052608:12345-192.168.203.41@tcp:101:touch.0 00000100:00100000:0.0:1705683932.496174:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.496176:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.496182:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098414500/0xefc4487a018793ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x4265:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015a1 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.496184:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:7259:x1788538641052544:12345-192.168.203.41@tcp:101:dd.0 Request processed in 349us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.496189:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920971 00000100:00100000:1.0:1705683932.496197:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496198:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496201:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052672 00010000:00010000:3.0:1705683932.496207:0:14222:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098414500/0xefc4487a018793ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4265:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015a1 expref: 1933 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.496211:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496211:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.496212:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098414500/0xefc4487a018793ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x4265:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015a1 expref: 1933 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.496215:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920972 00000100:00100000:1.0:1705683932.496217:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3474:6521:x1788538641052672:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.496220:0:14222:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4265:0x0].0x0 (ffff880131598500) 00010000:00010000:3.0:1705683932.496221:0:14222:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1705683932.496222:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098414500, rc 0) 00010000:00010000:1.0:1705683932.496223:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.496229:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.496235:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b25000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1933:7371:x1788538641052608:12345-192.168.203.41@tcp:101:touch.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.496242:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413476 00000100:00100000:3.0:1705683932.496295:0:14196:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496296:0:14196:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496300:0:14196:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052352 00000100:00100000:3.0:1705683932.496308:0:14196:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496309:0:14196:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496311:0:14196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413477 00000100:00100000:3.0:1705683932.496312:0:14196:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1933:7373:x1788538641052352:12345-192.168.203.41@tcp:101:touch.0 00010000:00010000:3.0:1705683932.496316:0:14196:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.496320:0:14196:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098414c80/0xefc4487a018793b5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301585 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.496407:0:14196:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14196 initiator: MDT0 00000100:00100000:0.0:1705683932.496411:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa2cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584524864:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.496411:0:14196:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496415:0:14196:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00010000:00010000:0.0:1705683932.496426:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30157e expref: 3553 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.496429:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131f9ca00/0xefc4487a018793c3 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015a8 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.496435:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba7700, rc 0) 00002000:00010000:1.0:1705683932.496438:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.496448:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496448:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.496449:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:6554:x1788538641052096:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1607us (1646us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.496451:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131f9ca00/0xefc4487a018793c3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015a8 expref: 3475 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496454:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920968 00010000:00010000:1.0:1705683932.496461:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131f9ca00/0xefc4487a018793c3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015a8 expref: 3475 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.496466:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f9ca00, rc 0) 00000100:00100000:1.0:1705683932.496479:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b21900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3475:6521:x1788538641052672:12345-192.168.203.41@tcp:101:dd.0 Request processed in 261us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.496483:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920972 00010000:00010000:3.0:1705683932.496496:0:14196:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14196 initiator: MDT0 00010000:00010000:1.0:1705683932.496499:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.496499:0:14196:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496501:0:14196:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00000100:00100000:0.0:1705683932.496509:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.496528:0:14196:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098417980/0xefc4487a018793d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4236:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14196 initiator: MDT0 00010000:00010000:3.0:1705683932.496534:0:14196:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098417980/0xefc4487a018793d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4236:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496537:0:14196:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098417980/0xefc4487a018793d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4236:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00000004:00200000:3.0:1705683932.496541:0:14196:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x4236:0x0]: returning size 0 00000100:00100000:0.0:1705683932.496551:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.496576:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.496584:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.496585:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.496588:0:14196:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496591:0:14196:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496593:0:14196:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496596:0:14196:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496599:0:14196:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098416080 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.496600:0:14196:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496603:0:14196:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496607:0:14196:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x0 (ffff88008188ec00) 00010000:00010000:3.0:1705683932.496608:0:14196:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.496609:0:14196:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496611:0:14196:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098416080/0xefc4487a018793bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x422f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496623:0:14196:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496627:0:14196:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496630:0:14196:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496633:0:14196:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff880098417700 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.496635:0:14196:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496639:0:14196:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496643:0:14196:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x422f:0x0].0x3331 (ffff8800a6fe8900) 00010000:00010000:3.0:1705683932.496645:0:14196:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.496646:0:14196:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 2/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14196 initiator: MDT1 00010000:00010000:3.0:1705683932.496649:0:14196:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098417700/0xefc4487a018793ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x422f:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14196 initiator: MDT1 00000100:00100000:0.0:1705683932.496654:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052800 00010000:00010000:0.0:1705683932.496665:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5940 pid: 15108 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.496681:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.496682:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.496682:0:14196:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098414c80/0xefc4487a018793b5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x422f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301585 expref: 1936 pid: 14196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496684:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052864 00010000:00010000:0.0:1705683932.496691:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.496691:0:14196:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098417980/0xefc4487a018793d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4236:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301585 expref: 1935 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.496695:0:14196:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4236:0x0].0x0 (ffff88009d2b0a00) 00010000:00010000:3.0:1705683932.496698:0:14196:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1705683932.496699:0:14196:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098417980, rc 0) 00000100:00100000:1.0:1705683932.496702:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496703:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496720:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333071 00000100:00100000:1.0:1705683932.496724:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:1856:x1788538641052800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.496727:0:14196:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b26900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1935:7373:x1788538641052352:12345-192.168.203.41@tcp:101:touch.0 Request processed in 413us (498us total) trans 4295085009 rc 0/0 00010000:00010000:1.0:1705683932.496729:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.496732:0:14196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413477 00010000:00010000:1.0:1705683932.496737:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5940 pid: 15108 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.496742:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5940 pid: 15108 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.496749:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496750:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.496752:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f5f480/0xefc4487a01847a85 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecce7 expref: 5940 pid: 15108 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.496754:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052736 00010000:00010000:1.0:1705683932.496760:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496761:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496763:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301569 expref: 3975 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496765:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.496766:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496766:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496767:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.496768:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301569 expref: 3975 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496770:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333072 00000100:00100000:3.0:1705683932.496770:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920973 00000100:00100000:3.0:1705683932.496772:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3475:16415:x1788538641052736:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.496774:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4df8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:1856:x1788538641052864:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.496778:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.496779:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131f9d400/0xefc4487a0187936f lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301569 expref: 3975 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.496780:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.496785:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584524992:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.496787:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.496794:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.496800:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.496804:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba300/0xefc4487a01863617 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb258 expref: 3553 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.496812:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.496813:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.496814:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30157e expref: 3552 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.496819:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30157e expref: 3552 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.496834:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba7700/0xefc4487a01879392 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30157e expref: 3552 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496841:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525056:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.496846:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015af expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.496847:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c0a00/0xefc4487a018793e6 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301593 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.496856:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.496856:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3552 pid: 14281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.496857:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39900 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.496859:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.496860:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.496861:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015af expref: 3476 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.496864:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496865:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.496867:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c0a00/0xefc4487a018793e6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301593 expref: 3553 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.496871:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3553 pid: 14281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.496874:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c0a00/0xefc4487a018793e6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301593 expref: 3553 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.496875:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3553 pid: 14281 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.496879:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c0a00, rc 0) 00000100:00100000:3.0:1705683932.496885:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584525120:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.496892:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:6496:x1788538641052480:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1141us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.496897:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920970 00000100:00100000:3.0:1705683932.496901:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584524928:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.496909:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30158c expref: 3476 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.496913:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098416800, rc 0) 00000100:00100000:0.0:1705683932.496914:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.496924:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496925:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496925:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3476:16443:x1788538641052416:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1184us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.496928:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920969 00000100:00100000:1.0:1705683932.496929:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052928 00000100:00100000:3.0:1705683932.496938:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496939:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.496940:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.496940:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496941:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.496942:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920974 00000100:00100000:3.0:1705683932.496944:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:7259:x1788538641052928:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.496945:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641052992 00010000:00010000:3.0:1705683932.496948:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.496953:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496954:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.496957:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920975 00000100:00100000:1.0:1705683932.496960:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3476:1855:x1788538641052992:12345-192.168.203.41@tcp:2:touch.0 00000100:00100000:0.0:1705683932.496994:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.497007:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.497008:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.497011:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053056 00010000:00010000:1.0:1705683932.497020:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3554 pid: 15170 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.497031:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.497031:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.497034:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333073 00000100:00100000:1.0:1705683932.497037:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3554:1857:x1788538641053056:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.497041:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.497043:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3554 pid: 15170 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.497049:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3554 pid: 15170 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.497060:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133061680/0xefc4487a017f7aa4 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cbf7e expref: 3554 pid: 15170 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.497066:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.497089:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.497092:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30158c expref: 3476 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.497097:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30158c expref: 3476 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.497112:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098416800/0xefc4487a018793a0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30158c expref: 3476 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.497119:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584525184:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.497137:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bda80 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.497225:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007352a800/0xefc4487a018793ed lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015b6 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.497233:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.497239:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.497240:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.497242:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007352a800/0xefc4487a018793ed lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015b6 expref: 3554 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.497247:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007352a800/0xefc4487a018793ed lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015b6 expref: 3554 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.497251:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352a800, rc 0) 00000100:00100000:3.0:1705683932.497264:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3554:7259:x1788538641052928:12345-192.168.203.41@tcp:101:dd.0 Request processed in 320us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.497267:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920974 00000100:00100000:1.0:1705683932.497271:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800973c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3477:1855:x1788538641052992:12345-192.168.203.41@tcp:2:touch.0 Request processed in 310us (330us total) trans 4295340572 rc 0/0 00000100:00100000:1.0:1705683932.497277:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920975 00000100:00100000:3.0:1705683932.497287:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.497351:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.497362:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497363:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497366:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053120 00000100:00100000:3.0:1705683932.497374:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497375:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497377:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920976 00000100:00100000:3.0:1705683932.497379:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:6521:x1788538641053120:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.497382:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.497652:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073528280/0xefc4487a018793f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015bd expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.497660:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.497666:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.497667:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.497669:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073528280/0xefc4487a018793f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015bd expref: 5941 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.497674:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073528280/0xefc4487a018793f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015bd expref: 5941 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.497678:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073528280, rc 0) 00000100:00100000:3.0:1705683932.497698:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5941:6521:x1788538641053120:12345-192.168.203.41@tcp:101:dd.0 Request processed in 318us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.497701:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920976 00000100:00100000:1.0:1705683932.497841:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584524992:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.497843:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880133636400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525056:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.497849:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.497854:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.497862:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:1856:x1788538641052800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1139us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.497866:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4df8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:1856:x1788538641052864:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1092us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.497867:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333071 00000100:00100000:0.0:1705683932.497871:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333072 00000100:00100000:1.0:1705683932.497891:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.497916:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497916:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497920:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053184 00000100:00100000:3.0:1705683932.497928:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497929:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.497931:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920977 00000100:00100000:3.0:1705683932.497933:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3976:6496:x1788538641053184:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.497937:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.497954:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.497965:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.497967:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.497972:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053248 00000100:00100000:1.0:1705683932.497975:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.497993:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.497994:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.497996:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053312 00000100:00100000:1.0:1705683932.497998:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.497999:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498005:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498005:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498005:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920978 00000100:00100000:0.0:1705683932.498009:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920979 00000100:00100000:1.0:1705683932.498009:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3977:6554:x1788538641053248:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.498012:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:4708:x1788538641053312:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.498014:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.498018:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.498051:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015cb expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.498063:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3978 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.498082:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.498083:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.498085:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015cb expref: 3978 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.498094:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015d2 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.498097:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3978 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.498104:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3978 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.498107:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.498110:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.498110:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584525248:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.498111:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.498112:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d2 expref: 3554 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.498121:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.498124:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.498127:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.498129:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf1900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584525312:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.498141:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.498272:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007352af80/0xefc4487a01879409 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015c4 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.498280:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9214:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.498288:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.498289:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.498292:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007352af80/0xefc4487a01879409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015c4 expref: 3979 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498299:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007352af80/0xefc4487a01879409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015c4 expref: 3979 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498305:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352af80, rc 0) 00000100:00100000:3.0:1705683932.498327:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:6496:x1788538641053184:12345-192.168.203.41@tcp:101:dd.0 Request processed in 392us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.498330:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.498330:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584525184:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.498332:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920977 00000100:00100000:0.0:1705683932.498335:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498336:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.498338:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.498339:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053376 00010000:00010000:0.0:1705683932.498347:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3555 pid: 14281 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.498349:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:1857:x1788538641053056:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1312us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.498354:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333073 00000100:00100000:0.0:1705683932.498355:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498355:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498355:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584525120:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.498357:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333074 00000100:00100000:0.0:1705683932.498359:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3554:1855:x1788538641053376:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.498363:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.498365:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3554 pid: 14281 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.498365:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015af expref: 3476 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.498369:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3554 pid: 14281 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.498373:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098416580, rc 0) 00000100:00100000:1.0:1705683932.498377:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.498379:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073762080/0xefc4487a0182039e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2d9fa1 expref: 3554 pid: 14281 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.498384:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3476:16415:x1788538641052736:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1612us (1877us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.498385:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.498385:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.498387:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015af expref: 3476 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.498388:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920973 00000100:00100000:1.0:1705683932.498390:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.498391:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015af expref: 3476 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.498395:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498395:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498398:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053440 00010000:00010000:0.0:1705683932.498400:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098416580/0xefc4487a018793df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015af expref: 3475 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.498400:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.498404:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525376:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.498411:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498412:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498414:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053568 00000100:00100000:0.0:1705683932.498415:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.498415:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498416:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498421:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920980 00000100:00100000:1.0:1705683932.498424:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:7259:x1788538641053440:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.498425:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498426:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498428:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920981 00000100:00100000:0.0:1705683932.498429:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498429:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.498429:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.498431:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5940:16443:x1788538641053568:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.498435:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.498501:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015e0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498514:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3979 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498519:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.498520:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.498521:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e0 expref: 5941 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498536:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3979 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498543:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3979 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.498551:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584525440:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.498569:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.498582:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498583:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498590:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053632 00000100:00100000:3.0:1705683932.498601:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498602:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.498604:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413478 00000100:00100000:3.0:1705683932.498606:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ce900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1935:7373:x1788538641053632:12345-192.168.203.41@tcp:36:touch.0 00010000:00010000:3.0:1705683932.498621:0:8825:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.498627:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098417980/0xefc4487a018793d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4236:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301585 expref: 1935 pid: 14196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.498633:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4236:0x0].0x0 (ffff88009d2b0a00) 00010000:00010000:3.0:1705683932.498635:0:8825:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.498657:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073528780/0xefc4487a01879417 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x4236:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.498661:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073528780/0xefc4487a01879417 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.498664:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073528780/0xefc4487a01879417 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:1.0:1705683932.498676:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c0780/0xefc4487a0187941e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015d9 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.498686:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.498693:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.498694:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.498696:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c0780/0xefc4487a0187941e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d9 expref: 3980 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.498703:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c0780/0xefc4487a0187941e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d9 expref: 3980 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.498720:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c0780, rc 0) 00000004:00010000:3.0:1705683932.498727:0:8825:0:(mdt_handler.c:4182:mdt_save_lock()) ### save lock request ffff88011d8ce900 reply state ffff880133028000 transno 4295085010 ns: mdt-lustre-MDT0001_UUID lock: ffff880073528780/0xefc4487a01879417 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x4236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.498734:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073528780/0xefc4487a01879417 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x4236:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.498736:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:7259:x1788538641053440:12345-192.168.203.41@tcp:101:dd.0 Request processed in 310us (358us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.498739:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4236:0x0].0x0 (ffff88009d2b0a00) 00000100:00100000:1.0:1705683932.498740:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920980 00010000:00010000:3.0:1705683932.498740:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1705683932.498771:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ce900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1936:7373:x1788538641053632:12345-192.168.203.41@tcp:36:touch.0 Request processed in 163us (369us total) trans 4295085010 rc 0/0 00000100:00100000:3.0:1705683932.498774:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413478 00000100:00100000:1.0:1705683932.498786:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.498796:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498796:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498803:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053760 00000100:00100000:1.0:1705683932.498825:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498826:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498828:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498829:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498830:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107576 00000100:00100000:1.0:1705683932.498833:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1936:7371:x1788538641053760:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:0.0:1705683932.498868:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf1900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584525312:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.498876:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d2 expref: 3553 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.498882:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba7200, rc 0) 00000100:00100000:0.0:1705683932.498890:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:4708:x1788538641053312:12345-192.168.203.41@tcp:101:dd.0 Request processed in 878us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.498894:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920979 00000100:00100000:0.0:1705683932.498913:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.498932:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1937:7371:x1788538641053760:12345-192.168.203.41@tcp:35:touch.0 Request processed in 98us (147us total) trans 4295085011 rc 0/0 00000100:00100000:1.0:1705683932.498937:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107576 00000100:00100000:1.0:1705683932.498951:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498951:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498954:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053824 00000100:00100000:0.0:1705683932.498956:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.498961:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3980 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.498970:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498971:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498972:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053888 00010000:00010000:1.0:1705683932.498977:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.498989:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498990:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.498992:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498992:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333075 00000100:00100000:0.0:1705683932.498993:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.498995:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1857:x1788538641053824:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.498997:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333076 00000100:00100000:0.0:1705683932.498999:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3476:1857:x1788538641053888:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.498999:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.499004:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.499005:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3980 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.499011:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.499011:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3980 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.499015:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.499023:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c8aef80/0xefc4487a01847a77 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccee expref: 3476 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.499025:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.499026:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.499028:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015cb expref: 3980 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.499030:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.499030:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.499032:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d2 expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.499033:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015cb expref: 3980 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.499036:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d2 expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.499046:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015cb expref: 3980 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.499053:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584525504:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.499069:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.499099:0:15148:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e2a080/0xefc4487a01863641 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9522:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb25f expref: 3980 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.499107:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584525248:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.499113:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba7200/0xefc4487a01879402 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015d2 expref: 3552 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.499118:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008fa28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584525568:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.499118:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c1900/0xefc4487a018793fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9522:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015cb expref: 3979 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.499123:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c1900, rc 0) 00000100:00100000:0.0:1705683932.499129:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.499136:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:6554:x1788538641053248:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1127us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.499140:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920978 00000100:00100000:0.0:1705683932.499149:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.499161:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499162:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499165:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641053952 00000100:00100000:1.0:1705683932.499175:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499176:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499179:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920982 00000100:00100000:1.0:1705683932.499181:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3476:6521:x1788538641053952:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.499186:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.499307:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c3700/0xefc4487a01879425 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015e7 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.499317:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.499324:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.499325:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.499327:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c3700/0xefc4487a01879425 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e7 expref: 3477 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.499333:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c3700/0xefc4487a01879425 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e7 expref: 3477 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.499338:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c3700, rc 0) 00000100:00100000:1.0:1705683932.499349:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3477:6521:x1788538641053952:12345-192.168.203.41@tcp:101:dd.0 Request processed in 167us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.499353:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920982 00000100:00100000:1.0:1705683932.499458:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.499461:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584525440:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.499466:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499467:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.499470:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e0 expref: 5941 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.499471:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054016 00000100:00100000:0.0:1705683932.499472:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525376:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.499478:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073529180, rc 0) 00000100:00100000:1.0:1705683932.499482:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.499482:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.499483:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.499486:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920983 00000100:00100000:1.0:1705683932.499489:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3477:1855:x1788538641054016:12345-192.168.203.41@tcp:2:touch.0 00000100:00100000:3.0:1705683932.499496:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5941:16443:x1788538641053568:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1063us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.499499:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:1855:x1788538641053376:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1138us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.499501:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920981 00000100:00100000:0.0:1705683932.499504:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333074 00000100:00100000:0.0:1705683932.499555:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.499564:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499565:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499569:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054080 00000100:00100000:0.0:1705683932.499585:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499586:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499589:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920984 00000100:00100000:0.0:1705683932.499592:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa2c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3552:6496:x1788538641054080:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.499598:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.499732:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3478:1855:x1788538641054016:12345-192.168.203.41@tcp:2:touch.0 Request processed in 242us (274us total) trans 4295340573 rc 0/0 00000100:00100000:1.0:1705683932.499738:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920983 00010000:00010000:0.0:1705683932.499799:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba4280/0xefc4487a0187942c lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015ee expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.499812:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.499821:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.499822:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.499825:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4280/0xefc4487a0187942c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015ee expref: 3553 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.499831:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba4280/0xefc4487a0187942c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015ee expref: 3553 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.499894:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba4280, rc 0) 00000100:00100000:0.0:1705683932.499909:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa2c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3553:6496:x1788538641054080:12345-192.168.203.41@tcp:101:dd.0 Request processed in 316us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.499914:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920984 00000100:00100000:1.0:1705683932.499920:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.499922:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499922:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499926:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054144 00000100:00100000:0.0:1705683932.499935:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499936:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.499939:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920985 00000100:00100000:0.0:1705683932.499942:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5941:16415:x1788538641054144:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.499947:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.500134:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015f5 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500147:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3978 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500157:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.500158:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.500160:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015f5 expref: 5942 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500172:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3978 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500178:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3978 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.500185:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584525632:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.500201:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.500349:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584525504:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.500350:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008fa28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584525568:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.500360:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.500361:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.500372:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3477:1857:x1788538641053888:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1372us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.500374:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:1857:x1788538641053824:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1378us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.500377:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333076 00000100:00100000:1.0:1705683932.500380:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333075 00000100:00100000:0.0:1705683932.500454:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.500466:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500467:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.500468:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.500480:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054208 00000100:00100000:0.0:1705683932.500487:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.500491:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500492:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500494:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054272 00000100:00100000:3.0:1705683932.500497:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500498:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.500502:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.500502:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054400 00000100:00100000:1.0:1705683932.500508:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500509:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500510:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500510:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500512:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054464 00000100:00100000:0.0:1705683932.500513:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.500514:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500517:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920986 00000100:00100000:3.0:1705683932.500520:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fa28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3554:7259:x1788538641054208:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.500521:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920987 00010000:00010000:3.0:1705683932.500525:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.500526:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3554:6554:x1788538641054272:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.500528:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500529:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.500532:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.500533:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920988 00000100:00100000:1.0:1705683932.500535:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:6521:x1788538641054464:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.500541:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.500561:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301603 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500573:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3555 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.500577:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.500579:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.500580:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301603 expref: 3555 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500649:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3555 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.500656:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3555 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.500663:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584525696:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.500681:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.500698:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.500764:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584525632:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.500774:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015f5 expref: 5943 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.500786:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba5e00, rc 0) 00010000:00010000:3.0:1705683932.500788:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073528f00/0xefc4487a01879441 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3015fc expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.500797:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.500801:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:16415:x1788538641054144:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 859us (882us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.500804:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.500805:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.500806:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920985 00010000:00010000:3.0:1705683932.500808:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073528f00/0xefc4487a01879441 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015fc expref: 3556 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.500813:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073528f00/0xefc4487a01879441 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015fc expref: 3556 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.500816:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073528f00, rc 0) 00010000:00010000:1.0:1705683932.500826:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c2800/0xefc4487a01879448 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301611 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.500828:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fa28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:7259:x1788538641054208:12345-192.168.203.41@tcp:101:dd.0 Request processed in 308us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.500831:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920986 00002000:00010000:1.0:1705683932.500836:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.500845:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.500846:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.500848:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.500849:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c2800/0xefc4487a01879448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301611 expref: 5943 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.500849:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.500850:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.500851:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920989 00000100:00100000:3.0:1705683932.500853:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133636400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3978:4708:x1788538641054400:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.500856:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c2800/0xefc4487a01879448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301611 expref: 5943 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.500856:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.500862:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c2800, rc 0) 00000100:00100000:1.0:1705683932.500912:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:6521:x1788538641054464:12345-192.168.203.41@tcp:101:dd.0 Request processed in 376us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.500916:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920988 00010000:00010000:3.0:1705683932.500919:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30160a expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.500929:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5942 pid: 15106 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.500930:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500931:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.500932:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.500933:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.500933:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.500935:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30160a expref: 3979 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.500936:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054592 00010000:00010000:3.0:1705683932.500944:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5942 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.500948:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5942 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.500952:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500953:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500953:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584525760:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.500954:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.500955:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.500957:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107577 00000100:00100000:1.0:1705683932.500960:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1937:7373:x1788538641054592:12345-192.168.203.41@tcp:35:touch.0 00000100:00100000:3.0:1705683932.500967:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.500973:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500973:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500976:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054656 00000100:00100000:3.0:1705683932.500983:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500984:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.500986:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920990 00000100:00100000:3.0:1705683932.500988:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:6496:x1788538641054656:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.500991:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.501036:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1938:7373:x1788538641054592:12345-192.168.203.41@tcp:35:touch.0 Request processed in 75us (186us total) trans 4295085012 rc 0/0 00000100:00100000:1.0:1705683932.501041:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107577 00000100:00100000:1.0:1705683932.501053:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501054:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501057:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054336 00010000:00010000:1.0:1705683932.501066:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.501096:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501098:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501101:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333077 00000100:00100000:1.0:1705683932.501104:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055e400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:1856:x1788538641054336:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.501110:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.501113:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.501118:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.501128:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae13700/0xefc4487a017f7c72 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc003 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.501136:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501137:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501139:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e0 expref: 5942 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501144:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e0 expref: 5942 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501158:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880073529180/0xefc4487a01879410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015e0 expref: 5942 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.501165:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584525824:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.501186:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.501192:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.501200:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.501201:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.501205:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054720 00010000:00010000:3.0:1705683932.501209:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007352a300/0xefc4487a01879456 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9215:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301618 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.501214:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1705683932.501216:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9215:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.501222:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.501223:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.501226:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.501226:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007352a300/0xefc4487a01879456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301618 expref: 3982 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.501227:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.501230:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333078 00000100:00100000:0.0:1705683932.501233:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:1857:x1788538641054720:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.501234:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007352a300/0xefc4487a01879456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301618 expref: 3982 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.501238:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.501238:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352a300, rc 0) 00010000:00010000:0.0:1705683932.501241:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3982 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.501247:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3982 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.501248:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:6496:x1788538641054656:12345-192.168.203.41@tcp:101:dd.0 Request processed in 260us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.501251:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920990 00010000:00010000:0.0:1705683932.501258:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cd5680/0xefc4487a018206bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da073 expref: 3981 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.501268:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.501269:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.501271:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015f5 expref: 5942 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.501380:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015f5 expref: 5942 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.501396:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099ba5e00/0xefc4487a01879433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3015f5 expref: 5942 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.501402:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584525888:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.501421:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.501476:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584525696:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.501481:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.501487:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301603 expref: 3555 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501495:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6300, rc 0) 00000100:00100000:1.0:1705683932.501503:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501503:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501507:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054784 00010000:00010000:1.0:1705683932.501516:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3556 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.501526:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501527:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501529:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333079 00000100:00100000:1.0:1705683932.501532:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4290050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:1856:x1788538641054784:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.501536:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.501542:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3556 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.501547:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3556 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.501556:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e080/0xefc4487a0186363a lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb266 expref: 3556 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.501564:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501565:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501567:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301603 expref: 3555 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501576:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301603 expref: 3555 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.501579:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584525760:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.501587:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30160a expref: 3980 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501589:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba6300/0xefc4487a0187943a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301603 expref: 3555 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.501593:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352b700, rc 0) 00000100:00100000:1.0:1705683932.501596:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525952:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.501606:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133636400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:4708:x1788538641054400:12345-192.168.203.41@tcp:101:dd.0 Request processed in 752us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.501609:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920989 00000100:00100000:1.0:1705683932.501613:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bde40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.501628:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135575000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:6554:x1788538641054272:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1102us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.501633:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920987 00000100:00100000:0.0:1705683932.501819:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.501832:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.501833:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501834:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501839:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054848 00000100:00100000:1.0:1705683932.501845:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501846:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501849:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054912 00010000:00010000:1.0:1705683932.501857:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5943 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.501869:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501869:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501872:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333080 00000100:00100000:1.0:1705683932.501875:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055f300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:1856:x1788538641054912:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.501876:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.501880:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.501887:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5943 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.501893:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5943 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.501902:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f21900/0xefc4487a01847a93 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccf5 expref: 5943 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.501905:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.501906:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.501910:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641054976 00010000:00010000:1.0:1705683932.501911:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501912:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.501914:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30160a expref: 3980 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.501918:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30160a expref: 3980 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.501923:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.501923:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.501927:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920991 00000100:00100000:3.0:1705683932.501930:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090558a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3477:6521:x1788538641054976:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.501932:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007352b700/0xefc4487a0187944f lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30160a expref: 3980 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.501935:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.501939:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526016:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.501958:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.501980:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501981:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.501985:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920992 00000100:00100000:1.0:1705683932.501988:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:7259:x1788538641054848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.501993:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.502101:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584525888:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.502110:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.502124:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:1857:x1788538641054720:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 890us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.502129:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333078 00010000:00010000:3.0:1705683932.502148:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007352b480/0xefc4487a0187945d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301626 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.502161:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.502168:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.502168:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.502171:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007352b480/0xefc4487a0187945d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301626 expref: 3478 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.502176:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007352b480/0xefc4487a0187945d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301626 expref: 3478 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.502179:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352b480, rc 0) 00000100:00100000:3.0:1705683932.502190:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090558a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3478:6521:x1788538641054976:12345-192.168.203.41@tcp:101:dd.0 Request processed in 259us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.502192:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920991 00000100:00100000:0.0:1705683932.502244:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.502275:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502276:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502280:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055040 00000100:00100000:3.0:1705683932.502291:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502292:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502295:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920993 00000100:00100000:3.0:1705683932.502298:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:6496:x1788538641055040:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.502304:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584525824:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.502304:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.502316:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.502329:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055e400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:1856:x1788538641054336:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1223us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.502333:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333077 00010000:00010000:1.0:1705683932.502349:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c1b80/0xefc4487a01879464 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30161f expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.502358:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.502365:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.502367:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.502369:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c1b80/0xefc4487a01879464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30161f expref: 3979 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502376:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c1b80/0xefc4487a01879464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30161f expref: 3979 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502381:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c1b80, rc 0) 00000100:00100000:0.0:1705683932.502388:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.502394:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:7259:x1788538641054848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 406us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.502399:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920992 00000100:00100000:1.0:1705683932.502410:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502411:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502414:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055104 00000100:00100000:1.0:1705683932.502424:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502424:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502427:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920994 00000100:00100000:1.0:1705683932.502430:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3478:16443:x1788538641055104:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.502435:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.502518:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.502524:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073529900/0xefc4487a0187946b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30162d expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.502536:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.502544:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.502545:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.502548:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584525952:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.502548:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073529900/0xefc4487a0187946b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30162d expref: 3556 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.502555:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073529900/0xefc4487a0187946b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30162d expref: 3556 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502556:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.502560:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.502561:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073529900, rc 0) 00000100:00100000:1.0:1705683932.502566:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4290050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:1856:x1788538641054784:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1034us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.502570:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333079 00000100:00100000:3.0:1705683932.502576:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502577:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502581:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055168 00000100:00100000:3.0:1705683932.502593:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502594:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502596:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502596:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502597:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055232 00000100:00100000:1.0:1705683932.502601:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920995 00000100:00100000:1.0:1705683932.502605:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3979:6554:x1788538641055168:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.502610:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.502611:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.502611:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.502614:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920996 00000100:00100000:3.0:1705683932.502617:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3479:16415:x1788538641055232:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.502623:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.502630:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30163b expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.502648:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526016:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.502656:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.502668:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055f300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5942:1856:x1788538641054912:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 793us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.502672:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333080 00010000:00010000:3.0:1705683932.502683:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301642 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502686:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3980 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.502692:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.502693:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.502693:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3555 pid: 15115 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502694:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30163b expref: 3980 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.502697:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.502697:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.502699:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301642 expref: 3480 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502707:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3980 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.502717:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3555 pid: 15115 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.502724:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3555 pid: 15115 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.502725:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3980 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.502729:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584526144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.502733:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584526080:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.502747:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.502749:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.502759:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301634 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502770:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3555 pid: 15136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.502771:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:6496:x1788538641055040:12345-192.168.203.41@tcp:101:dd.0 Request processed in 472us (528us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.502774:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.502774:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.502776:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301634 expref: 3481 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.502776:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920993 00010000:00010000:1.0:1705683932.502785:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3554 pid: 15136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.502790:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3554 pid: 15136 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.502795:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584526208:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.502808:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.502951:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.502964:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502965:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502970:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055296 00000100:00100000:1.0:1705683932.502987:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502988:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.502991:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920997 00000100:00100000:1.0:1705683932.502994:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:4708:x1788538641055296:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.503000:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.503064:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301649 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503089:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.503093:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503094:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503095:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301649 expref: 3556 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503105:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.503110:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.503116:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584526272:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.503131:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.503374:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.503385:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584526144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.503394:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503395:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.503396:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301642 expref: 3481 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.503399:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055360 00000100:00100000:0.0:1705683932.503400:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.503402:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352a080, rc 0) 00010000:00010000:1.0:1705683932.503409:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3557 pid: 15115 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.503423:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.503423:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3481:16415:x1788538641055232:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 804us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.503424:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.503428:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503428:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333081 00000100:00100000:3.0:1705683932.503428:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920996 00000100:00100000:0.0:1705683932.503429:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503431:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3557:1854:x1788538641055360:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.503436:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.503436:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.503437:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.503438:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3557 pid: 15115 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.503440:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055424 00010000:00010000:1.0:1705683932.503444:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3557 pid: 15115 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.503450:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.503450:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.503453:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134c50500/0xefc4487a01820a58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da14c expref: 3557 pid: 15115 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.503453:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920998 00000100:00100000:3.0:1705683932.503455:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5942:6521:x1788538641055424:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.503459:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.503461:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503461:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503463:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301642 expref: 3480 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503468:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301642 expref: 3480 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503483:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007352a080/0xefc4487a01879479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301642 expref: 3480 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.503493:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584526336:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.503509:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.503574:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584526272:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.503587:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301649 expref: 3556 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503594:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c2580, rc 0) 00000100:00100000:1.0:1705683932.503608:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:4708:x1788538641055296:12345-192.168.203.41@tcp:101:dd.0 Request processed in 613us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.503613:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.503613:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920997 00000100:00100000:1.0:1705683932.503689:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503690:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503695:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055488 00000100:00100000:1.0:1705683932.503707:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503721:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.503726:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 920999 00010000:00010000:3.0:1705683932.503726:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007352aa80/0xefc4487a0187948e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301650 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.503729:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:7259:x1788538641055488:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.503735:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1705683932.503735:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.503741:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.503742:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.503744:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007352aa80/0xefc4487a0187948e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301650 expref: 5943 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.503749:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007352aa80/0xefc4487a0187948e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301650 expref: 5943 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.503753:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007352aa80, rc 0) 00000100:00100000:3.0:1705683932.503769:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:6521:x1788538641055424:12345-192.168.203.41@tcp:101:dd.0 Request processed in 313us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.503772:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920998 00010000:00010000:1.0:1705683932.503943:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c0c80/0xefc4487a01879495 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301657 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.503953:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.503961:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503962:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.503965:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c0c80/0xefc4487a01879495 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301657 expref: 3557 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503976:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c0c80/0xefc4487a01879495 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301657 expref: 3557 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.503981:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c0c80, rc 0) 00000100:00100000:1.0:1705683932.504006:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3557:7259:x1788538641055488:12345-192.168.203.41@tcp:101:dd.0 Request processed in 276us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.504011:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920999 00000100:00100000:1.0:1705683932.504036:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584526080:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.504046:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30163b expref: 3980 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504052:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c1680, rc 0) 00000100:00100000:1.0:1705683932.504088:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:6554:x1788538641055168:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1466us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.504094:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920995 00000100:00100000:3.0:1705683932.504100:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.504103:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504104:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504108:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055552 00000100:00100000:1.0:1705683932.504118:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504118:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504121:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921000 00000100:00100000:0.0:1705683932.504123:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504124:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504124:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3980:6496:x1788538641055552:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.504129:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.504238:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.504244:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504245:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504250:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055616 00010000:00010000:0.0:1705683932.504259:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.504271:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504272:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504274:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333082 00000100:00100000:0.0:1705683932.504277:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3481:1857:x1788538641055616:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.504283:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.504291:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.504298:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.504388:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c9d400/0xefc4487a01847a7e lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2eccfc expref: 3481 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.504389:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584526336:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.504398:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.504402:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.504403:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.504405:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301649 expref: 3556 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.504410:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301649 expref: 3556 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.504414:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:1854:x1788538641055360:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 983us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.504418:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333081 00010000:00010000:0.0:1705683932.504425:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801322c2580/0xefc4487a01879487 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301649 expref: 3555 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504432:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c3200/0xefc4487a0187949c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9216:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30165e expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.504442:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9216:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.504449:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.504450:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.504453:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c3200/0xefc4487a0187949c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30165e expref: 3981 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504459:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c3200/0xefc4487a0187949c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30165e expref: 3981 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504465:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c3200, rc 0) 00000100:00100000:1.0:1705683932.504477:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:6496:x1788538641055552:12345-192.168.203.41@tcp:101:dd.0 Request processed in 352us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.504481:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009055e400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584526400:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.504481:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921000 00000100:00100000:1.0:1705683932.504496:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584526208:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.504500:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.504504:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301634 expref: 3480 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504509:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c2300, rc 0) 00000100:00100000:1.0:1705683932.504518:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3480:16443:x1788538641055104:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2088us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.504522:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 920994 00000100:00100000:0.0:1705683932.504524:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.504532:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504533:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504537:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055744 00010000:00010000:0.0:1705683932.504546:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3556 pid: 15136 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.504556:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504557:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504560:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333083 00000100:00100000:1.0:1705683932.504561:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504562:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504563:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009055df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:1857:x1788538641055744:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.504568:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.504570:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3556 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.504576:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3556 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.504586:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098750a00/0xefc4487a017f7e32 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc05e expref: 3556 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.504592:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.504593:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.504595:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301634 expref: 3479 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.504600:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301634 expref: 3479 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.504613:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801322c2300/0xefc4487a01879480 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301634 expref: 3479 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.504619:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584526464:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.504678:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.504707:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.504729:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504729:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504732:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055680 00010000:00010000:1.0:1705683932.504739:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3981 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.504742:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.504754:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504755:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504757:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504758:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504758:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333084 00000100:00100000:1.0:1705683932.504761:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:1857:x1788538641055680:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.504766:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.504773:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3981 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.504778:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3981 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.504787:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a14b8000/0xefc4487a01863648 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9523:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb26d expref: 3981 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.504795:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.504796:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.504797:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30163b expref: 3980 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.504802:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30163b expref: 3980 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.504804:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.504818:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801322c1680/0xefc4487a01879472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9523:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30163b expref: 3980 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.504825:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526528:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.504850:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.504858:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504859:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504862:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055808 00000100:00100000:1.0:1705683932.504872:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504873:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504874:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055872 00000100:00100000:1.0:1705683932.504880:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504880:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.504884:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921001 00000100:00100000:1.0:1705683932.504886:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5943:16415:x1788538641055808:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.504892:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.504916:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504917:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.504924:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921002 00000100:00100000:0.0:1705683932.504928:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:7259:x1788538641055872:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.504934:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.504984:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.504997:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.504998:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505002:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641055936 00000100:00100000:3.0:1705683932.505010:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505011:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505013:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921003 00000100:00100000:3.0:1705683932.505015:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907af300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3480:6521:x1788538641055936:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.505019:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.505063:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba6080/0xefc4487a018794aa lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30166c expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.505063:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301665 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.505088:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3981 pid: 15097 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.505092:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.505093:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00002000:00010000:0.0:1705683932.505094:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.505094:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301665 expref: 5944 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.505102:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.505103:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.505104:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3982 pid: 15097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.505106:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba6080/0xefc4487a018794aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30166c expref: 3982 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.505110:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3982 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.505114:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba6080/0xefc4487a018794aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30166c expref: 3982 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.505116:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584526592:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.505119:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6080, rc 0) 00000100:00100000:1.0:1705683932.505135:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.505137:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:7259:x1788538641055872:12345-192.168.203.41@tcp:101:dd.0 Request processed in 209us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.505142:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921002 00010000:00010000:3.0:1705683932.505254:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073529e00/0xefc4487a018794b1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301673 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.505266:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.505273:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.505273:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.505276:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073529e00/0xefc4487a018794b1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301673 expref: 3481 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.505282:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073529e00/0xefc4487a018794b1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301673 expref: 3481 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.505287:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073529e00, rc 0) 00000100:00100000:3.0:1705683932.505307:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907af300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3481:6521:x1788538641055936:12345-192.168.203.41@tcp:101:dd.0 Request processed in 290us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.505312:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921003 00000100:00100000:0.0:1705683932.505848:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584526464:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.505856:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.505866:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009055df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:1857:x1788538641055744:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1303us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.505871:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333083 00000100:00100000:1.0:1705683932.505871:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009055e400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584526400:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.505881:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.505886:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.505894:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3480:1857:x1788538641055616:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1615us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.505899:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333082 00000100:00100000:3.0:1705683932.505913:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505914:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505919:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056000 00000100:00100000:3.0:1705683932.505929:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505929:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.505932:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921004 00000100:00100000:1.0:1705683932.505933:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526528:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.505934:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.505934:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3555:6496:x1788538641056000:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.505938:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.505940:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.505941:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.505942:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.505944:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056064 00000100:00100000:0.0:1705683932.505953:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.505953:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.505955:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921005 00000100:00100000:0.0:1705683932.505957:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880086026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3556:6554:x1788538641056064:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.505957:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:1857:x1788538641055680:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1195us (1250us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.505962:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.505962:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333084 00010000:00010000:0.0:1705683932.505988:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301681 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.505989:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.505997:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3557 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.506000:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.506001:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.506002:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301681 expref: 3557 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.506011:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3557 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.506016:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3557 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.506022:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584526656:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.506036:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.506039:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.506045:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506045:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506049:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056128 00000100:00100000:1.0:1705683932.506062:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506062:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506064:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056192 00000100:00100000:1.0:1705683932.506090:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506091:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506094:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921006 00000100:00100000:1.0:1705683932.506097:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5945:16443:x1788538641056128:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.506103:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.506168:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737cd400/0xefc4487a018794bf lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30167a expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.506180:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.506188:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506189:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506192:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737cd400/0xefc4487a018794bf lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30167a expref: 3558 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.506200:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737cd400/0xefc4487a018794bf lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30167a expref: 3558 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.506206:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cd400, rc 0) 00000100:00100000:3.0:1705683932.506219:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:6496:x1788538641056000:12345-192.168.203.41@tcp:101:dd.0 Request processed in 284us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.506222:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921004 00000100:00100000:3.0:1705683932.506227:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506228:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506230:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921007 00000100:00100000:3.0:1705683932.506233:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3981:4708:x1788538641056192:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.506237:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.506290:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.506304:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301688 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.506311:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30168f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506316:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3981 pid: 14249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506320:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.506322:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.506323:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301688 expref: 5946 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.506325:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5946 pid: 14405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.506328:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506329:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506330:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30168f expref: 3982 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506334:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3982 pid: 14249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506340:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3982 pid: 14249 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.506343:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5946 pid: 14405 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.506347:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584526720:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.506355:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5946 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.506363:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.506364:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584526784:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.506373:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506374:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506379:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056256 00000100:00100000:3.0:1705683932.506386:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.506391:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506392:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506396:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921008 00000100:00100000:3.0:1705683932.506397:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506398:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506399:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:7259:x1788538641056256:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.506406:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.506424:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.506433:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506433:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506436:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056320 00000100:00100000:3.0:1705683932.506446:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506446:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.506449:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921009 00000100:00100000:0.0:1705683932.506450:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.506451:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5947:6521:x1788538641056320:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.506455:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.506598:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c1400/0xefc4487a018794d4 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301696 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.506608:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.506614:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.506615:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.506618:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c1400/0xefc4487a018794d4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301696 expref: 3559 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506624:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c1400/0xefc4487a018794d4 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301696 expref: 3559 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506629:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c1400, rc 0) 00000100:00100000:1.0:1705683932.506641:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:7259:x1788538641056256:12345-192.168.203.41@tcp:101:dd.0 Request processed in 241us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.506645:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921008 00000100:00100000:1.0:1705683932.506657:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506658:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506661:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056384 00010000:00010000:1.0:1705683932.506667:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3983 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.506682:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.506682:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.506682:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737cef80/0xefc4487a018794db lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30169d expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.506685:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333085 00000100:00100000:1.0:1705683932.506687:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:1855:x1788538641056384:12345-192.168.203.41@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1705683932.506691:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.506692:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.506694:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3983 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.506697:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506698:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.506699:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3983 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.506700:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cef80/0xefc4487a018794db lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30169d expref: 5948 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.506705:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737cef80/0xefc4487a018794db lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30169d expref: 5948 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506721:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.506722:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.506726:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cef80, rc 0) 00000100:00100000:3.0:1705683932.506738:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5948:6521:x1788538641056320:12345-192.168.203.41@tcp:101:dd.0 Request processed in 286us (316us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.506741:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301665 expref: 5948 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.506741:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921009 00010000:00010000:1.0:1705683932.506760:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301665 expref: 5947 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506774:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301665 expref: 5947 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.506780:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526848:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.506798:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009c2ba840 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.506820:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800988f4f00/0xefc4487a01821373 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da1e6 expref: 3983 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.506828:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584526592:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.506838:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c0500/0xefc4487a018794a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301665 expref: 5947 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.506843:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c0500, rc 0) 00000100:00100000:1.0:1705683932.506856:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbf4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5947:16415:x1788538641055808:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1969us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.506861:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921001 00000100:00100000:0.0:1705683932.507654:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.507664:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.507667:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584526848:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.507678:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584526784:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.507679:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.507692:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30168f expref: 3982 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.507696:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:1855:x1788538641056384:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1007us (1246us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.507699:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cc280, rc 0) 00000100:00100000:1.0:1705683932.507700:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333085 00000100:00100000:0.0:1705683932.507701:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507702:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507706:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056512 00010000:00010000:0.0:1705683932.507725:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3982 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.507725:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:4708:x1788538641056192:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1490us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.507730:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921007 00000100:00100000:0.0:1705683932.507734:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507735:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507737:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333086 00000100:00100000:1.0:1705683932.507738:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009bbf0500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584526656:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.507739:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:1855:x1788538641056512:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.507742:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.507743:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.507743:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.507745:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3981 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.507746:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056640 00010000:00010000:0.0:1705683932.507749:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3982 pid: 14249 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.507749:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301681 expref: 3558 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.507756:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba4a00, rc 0) 00010000:00010000:0.0:1705683932.507757:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.507757:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.507758:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.507758:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.507759:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301688 expref: 5946 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.507761:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921010 00010000:00010000:0.0:1705683932.507762:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301688 expref: 5946 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.507763:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:6496:x1788538641056640:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.507768:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.507771:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880086026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:6554:x1788538641056064:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1812us (1836us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.507772:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301688 expref: 5946 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.507775:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921005 00000100:00100000:0.0:1705683932.507777:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584526912:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.507789:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.507803:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.507809:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507810:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507812:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056448 00010000:00010000:0.0:1705683932.507817:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3558 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.507823:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507824:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507826:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333087 00000100:00100000:0.0:1705683932.507827:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:1855:x1788538641056448:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.507831:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.507837:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3558 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.507840:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3558 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.507847:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14ba580/0xefc4487a01863633 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb274 expref: 3558 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.507852:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.507852:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.507853:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301681 expref: 3557 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.507857:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301681 expref: 3557 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.507865:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba4a00/0xefc4487a018794b8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301681 expref: 3557 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.507868:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b5f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584526976:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.507878:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.507899:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.507904:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507904:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507907:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056576 00010000:00010000:0.0:1705683932.507912:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5947 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.507920:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507921:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.507922:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333088 00000100:00100000:0.0:1705683932.507924:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b3200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5947:1855:x1788538641056576:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.507927:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.507933:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5947 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.507937:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5947 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.507946:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8ad680/0xefc4487a01847a8c lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd03 expref: 5947 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.507949:0:15133:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098415e00/0xefc4487a017f81ab lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc106 expref: 3982 pid: 14249 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.507954:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.507955:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.507956:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30168f expref: 3981 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.507959:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30168f expref: 3981 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.507959:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584526720:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.507967:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800737cc280/0xefc4487a018794cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30168f expref: 3981 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.507968:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801322c0280/0xefc4487a018794c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301688 expref: 5946 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.507970:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b0a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584527040:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.507973:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c0280, rc 0) 00000100:00100000:0.0:1705683932.507979:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.507986:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5946:16443:x1788538641056128:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1888us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.507990:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921006 00000100:00100000:0.0:1705683932.508041:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.508043:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737cd680/0xefc4487a018794e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9217:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016a4 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.508052:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508053:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:3.0:1705683932.508053:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9217:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.508055:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.508059:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056704 00010000:00010000:3.0:1705683932.508061:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508062:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508065:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cd680/0xefc4487a018794e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016a4 expref: 3982 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508071:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737cd680/0xefc4487a018794e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016a4 expref: 3982 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.508089:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508089:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508092:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056768 00010000:00010000:3.0:1705683932.508094:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cd680, rc 0) 00000100:00100000:1.0:1705683932.508102:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.508103:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.508103:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508107:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056832 00000100:00100000:1.0:1705683932.508116:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508117:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508117:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:6496:x1788538641056640:12345-192.168.203.41@tcp:101:dd.0 Request processed in 352us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.508121:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921011 00000100:00100000:1.0:1705683932.508124:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3481:6521:x1788538641056704:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.508127:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921010 00010000:00010000:1.0:1705683932.508130:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.508136:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508137:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508139:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921012 00000100:00100000:3.0:1705683932.508141:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:7259:x1788538641056768:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.508145:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.508226:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737ce800/0xefc4487a018794e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x964f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016b2 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.508233:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x964f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.508239:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508240:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508241:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ce800/0xefc4487a018794e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b2 expref: 3983 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508246:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737ce800/0xefc4487a018794e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x964f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b2 expref: 3983 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508253:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737ce800, rc 0) 00000100:00100000:3.0:1705683932.508265:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:7259:x1788538641056768:12345-192.168.203.41@tcp:101:dd.0 Request processed in 124us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.508268:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921012 00000100:00100000:3.0:1705683932.508274:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508275:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508277:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921013 00000100:00100000:3.0:1705683932.508279:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3481:16415:x1788538641056832:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.508283:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.508338:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801322c2f80/0xefc4487a018794f0 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016ab expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.508349:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.508357:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.508358:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.508361:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801322c2f80/0xefc4487a018794f0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ab expref: 3482 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.508368:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801322c2f80/0xefc4487a018794f0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ab expref: 3482 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.508373:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801322c2f80, rc 0) 00000100:00100000:1.0:1705683932.508389:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3482:6521:x1788538641056704:12345-192.168.203.41@tcp:101:dd.0 Request processed in 264us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.508394:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921011 00010000:00010000:3.0:1705683932.508471:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016b9 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508485:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3557 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508490:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.508491:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.508493:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b9 expref: 3482 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508506:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3557 pid: 15188 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508513:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3557 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.508525:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584527104:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.508543:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.508774:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b0a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584527040:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.508781:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.508787:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584526912:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.508791:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b3200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5945:1855:x1788538641056576:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 866us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.508794:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333088 00010000:00010000:1.0:1705683932.508796:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.508808:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:1855:x1788538641056512:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1068us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.508813:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333086 00000100:00100000:0.0:1705683932.508816:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b5f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584526976:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.508822:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.508827:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3557:1855:x1788538641056448:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 999us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.508830:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333087 00000100:00100000:0.0:1705683932.508847:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.508867:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.508876:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508877:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508882:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056896 00000100:00100000:0.0:1705683932.508898:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.508904:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508904:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508908:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641056960 00000100:00100000:1.0:1705683932.508914:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508915:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508919:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057024 00000100:00100000:3.0:1705683932.508921:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508922:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.508926:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921014 00000100:00100000:3.0:1705683932.508929:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3982:6554:x1788538641056896:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.508934:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.508934:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.508935:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.508938:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921015 00000100:00100000:1.0:1705683932.508941:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b0a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:16443:x1788538641056960:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.508945:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.508964:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.508980:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016c0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.508989:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3983 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.508993:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508994:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.508995:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c0 expref: 3983 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509003:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3983 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.509007:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3983 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.509012:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584527168:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.509027:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.509034:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509034:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509036:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057088 00000100:00100000:3.0:1705683932.509046:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509047:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509050:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921016 00000100:00100000:3.0:1705683932.509052:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:6496:x1788538641057024:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.509056:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.509094:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509095:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509100:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921017 00000100:00100000:0.0:1705683932.509102:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3558:4708:x1788538641057088:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.509108:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.509141:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016c7 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509153:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3558 pid: 15136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509157:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.509158:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.509159:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c7 expref: 3484 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509172:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3558 pid: 15136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509182:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3558 pid: 15136 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.509188:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584527232:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.509207:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.509220:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737cf980/0xefc4487a0187950c lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8399:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016ce expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.509226:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016d5 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.509231:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.509236:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3484 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.509239:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.509240:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.509240:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.509241:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.509242:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016d5 expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509243:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737cf980/0xefc4487a0187950c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ce expref: 3560 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509250:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737cf980/0xefc4487a0187950c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ce expref: 3560 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.509251:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3484 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.509255:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3484 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.509256:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cf980, rc 0) 00000100:00100000:0.0:1705683932.509259:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584527296:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.509271:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:6496:x1788538641057024:12345-192.168.203.41@tcp:101:dd.0 Request processed in 217us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.509274:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921016 00000100:00100000:0.0:1705683932.509312:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.509328:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.509360:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509361:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509371:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057216 00000100:00100000:0.0:1705683932.509386:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.509391:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509392:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509400:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509401:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509423:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057152 00000100:00100000:1.0:1705683932.509424:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509425:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509429:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921018 00000100:00100000:1.0:1705683932.509433:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:7259:x1788538641057216:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.509435:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509436:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.509438:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.509439:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921019 00000100:00100000:3.0:1705683932.509441:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5945:6521:x1788538641057152:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.509445:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.509460:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.509464:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509465:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509468:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057280 00010000:00010000:0.0:1705683932.509474:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3561 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.509486:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509487:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.509488:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333089 00000100:00100000:0.0:1705683932.509490:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3561:1856:x1788538641057280:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.509494:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.509495:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3561 pid: 15188 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.509499:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3561 pid: 15188 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.509508:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.509508:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.509510:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b9 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.509516:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b9 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.509525:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b9 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.509528:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584527360:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.509539:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.509543:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1e00/0xefc4487a0187951a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016dc expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509551:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737cc500/0xefc4487a01879521 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016e3 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.509553:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.509561:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.509562:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1705683932.509562:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.509564:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1e00/0xefc4487a0187951a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016dc expref: 3562 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509570:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.509570:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.509571:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1e00/0xefc4487a0187951a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016dc expref: 3562 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509573:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cc500/0xefc4487a01879521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016e3 expref: 5946 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509578:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737cc500/0xefc4487a01879521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016e3 expref: 5946 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509581:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1e00, rc 0) 00010000:00010000:3.0:1705683932.509582:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cc500, rc 0) 00000100:00100000:0.0:1705683932.509589:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.509595:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5946:6521:x1788538641057152:12345-192.168.203.41@tcp:101:dd.0 Request processed in 154us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.509598:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921019 00000100:00100000:1.0:1705683932.509600:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509601:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509605:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057344 00010000:00010000:1.0:1705683932.509614:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3984 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.509616:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca50000/0xefc4487a01821938 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da2cd expref: 3562 pid: 15188 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.509625:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.509625:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.509627:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584527104:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.509628:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333090 00000100:00100000:1.0:1705683932.509631:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:1857:x1788538641057344:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.509636:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.509637:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737cd900/0xefc4487a018794f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016b9 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509641:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cd900, rc 0) 00010000:00010000:1.0:1705683932.509642:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3984 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.509648:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3984 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.509652:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3484:16415:x1788538641056832:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1372us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.509654:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921013 00010000:00010000:1.0:1705683932.509659:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.509660:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.509667:0:15169:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dd2d180/0xefc4487a01863656 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9524:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb27b expref: 3984 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.509674:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584527168:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.509675:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c0 expref: 3983 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509681:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c0 expref: 3983 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509691:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c0 expref: 3983 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.509695:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737ce300, rc 0) 00010000:00010000:1.0:1705683932.509700:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800737ce300/0xefc4487a018794fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9524:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c0 expref: 3983 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.509704:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:6554:x1788538641056896:12345-192.168.203.41@tcp:101:dd.0 Request processed in 775us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.509717:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921014 00000100:00100000:1.0:1705683932.509721:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584527424:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.509742:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.509753:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3561:7259:x1788538641057216:12345-192.168.203.41@tcp:101:dd.0 Request processed in 319us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.509758:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921018 00000100:00100000:0.0:1705683932.509924:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584527296:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.509925:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584527232:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.509932:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016d5 expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.509937:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c7 expref: 3483 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.509938:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba4000, rc 0) 00010000:00010000:1.0:1705683932.509944:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c3200, rc 0) 00000100:00100000:0.0:1705683932.509947:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:4708:x1788538641057088:12345-192.168.203.41@tcp:101:dd.0 Request processed in 845us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.509950:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921017 00000100:00100000:1.0:1705683932.509958:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b0a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:16443:x1788538641056960:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1016us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.509962:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921015 00000100:00100000:1.0:1705683932.510047:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.510097:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.510107:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.510107:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.510111:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057536 00000100:00100000:3.0:1705683932.510116:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584527360:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.510122:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.510122:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.510125:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921020 00010000:00010000:3.0:1705683932.510127:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.510128:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3983:6496:x1788538641057536:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.510134:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.510141:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:1856:x1788538641057280:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 650us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.510142:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510142:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510145:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333089 00000100:00100000:0.0:1705683932.510146:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057408 00010000:00010000:0.0:1705683932.510155:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3559 pid: 15136 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.510170:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.510177:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510178:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510181:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057472 00010000:00010000:3.0:1705683932.510188:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3483 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.510196:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510196:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510198:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333091 00000100:00100000:3.0:1705683932.510200:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907ae400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:1854:x1788538641057472:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.510204:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.510211:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3483 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.510215:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3483 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.510226:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f5c780/0xefc4487a01847ae7 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd0a expref: 3483 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.510233:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510233:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510235:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016d5 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510238:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016d5 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510248:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba4000/0xefc4487a01879513 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016d5 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.510253:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584527488:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.510254:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510255:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510260:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333092 00000100:00100000:0.0:1705683932.510263:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:1854:x1788538641057408:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.510264:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.510269:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.510272:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3559 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.510278:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3559 pid: 15136 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.510287:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ebc000/0xefc4487a017f8364 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc153 expref: 3559 pid: 15136 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.510289:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.510294:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.510295:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.510297:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c7 expref: 3482 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.510343:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c7 expref: 3482 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.510350:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.510355:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3200/0xefc4487a01879505 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016c7 expref: 3482 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.510360:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009b07f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584527552:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.510364:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.510370:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510371:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510373:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057600 00000100:00100000:0.0:1705683932.510376:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.510381:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510381:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510382:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057664 00000100:00100000:0.0:1705683932.510384:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510385:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510388:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057728 00000100:00100000:3.0:1705683932.510389:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510390:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510392:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921021 00000100:00100000:3.0:1705683932.510394:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:6521:x1788538641057600:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.510398:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510398:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.510398:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.510401:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921022 00010000:00010000:1.0:1705683932.510401:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2300/0xefc4487a01879528 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9218:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016ea expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.510403:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:6554:x1788538641057664:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.510408:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1705683932.510411:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9218:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.510418:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.510419:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.510422:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2300/0xefc4487a01879528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ea expref: 3984 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.510423:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016f8 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510428:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2300/0xefc4487a01879528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ea expref: 3984 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.510430:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3560 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.510433:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.510433:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2300, rc 0) 00010000:00010000:0.0:1705683932.510434:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.510435:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f8 expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.510442:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3560 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.510446:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3560 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.510446:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:6496:x1788538641057536:12345-192.168.203.41@tcp:101:dd.0 Request processed in 317us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.510450:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009b07d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584527616:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.510450:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921020 00000100:00100000:1.0:1705683932.510459:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.510460:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.510460:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.510463:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921023 00000100:00100000:1.0:1705683932.510466:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5946:16415:x1788538641057728:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.510466:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737cfc00/0xefc4487a01879536 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016f1 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510471:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1705683932.510473:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.510479:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510480:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510482:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737cfc00/0xefc4487a01879536 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f1 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510486:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737cfc00/0xefc4487a01879536 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f1 expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510493:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cfc00, rc 0) 00000100:00100000:3.0:1705683932.510506:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3484:6521:x1788538641057600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 111us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.510509:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921021 00000100:00100000:0.0:1705683932.510579:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.510599:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510600:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510603:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057792 00000100:00100000:3.0:1705683932.510612:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510612:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.510615:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921024 00000100:00100000:3.0:1705683932.510616:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:7259:x1788538641057792:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.510620:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.510733:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3016ff expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510745:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510754:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.510754:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.510756:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ff expref: 5947 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510768:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.510775:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.510781:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584527680:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.510808:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.510826:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584527424:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.510836:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.510850:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:1857:x1788538641057344:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1218us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.510852:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584527488:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.510855:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333090 00010000:00010000:3.0:1705683932.510860:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.510873:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907ae400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:1854:x1788538641057472:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 672us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.510876:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333091 00010000:00010000:3.0:1705683932.510887:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800737cdb80/0xefc4487a01879544 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9650:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301706 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.510894:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9650:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.510900:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510900:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.510903:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800737cdb80/0xefc4487a01879544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301706 expref: 3984 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510914:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800737cdb80/0xefc4487a01879544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301706 expref: 3984 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.510919:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737cdb80, rc 0) 00000100:00100000:3.0:1705683932.510937:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:7259:x1788538641057792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 320us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.510942:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921024 00000100:00100000:0.0:1705683932.511046:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009b07d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584527616:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.511051:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009b07f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584527552:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.511054:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f8 expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.511059:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.511085:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:1854:x1788538641057408:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 821us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.511089:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333092 00010000:00010000:0.0:1705683932.511107:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba5400, rc 0) 00000100:00100000:0.0:1705683932.511118:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:6554:x1788538641057664:12345-192.168.203.41@tcp:101:dd.0 Request processed in 715us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.511118:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.511122:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921022 00000100:00100000:1.0:1705683932.511126:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511127:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511131:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057856 00010000:00010000:1.0:1705683932.511139:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3560 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.511150:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511152:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511154:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333093 00000100:00100000:1.0:1705683932.511157:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:1854:x1788538641057856:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.511162:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.511168:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3559 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.511173:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3559 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.511175:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.511180:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511181:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.511182:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b0b9180/0xefc4487a0186364f lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb282 expref: 3559 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.511183:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057920 00010000:00010000:1.0:1705683932.511189:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.511189:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.511190:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511191:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.511191:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f8 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.511192:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921025 00000100:00100000:0.0:1705683932.511194:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3559:6496:x1788538641057920:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.511196:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f8 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.511198:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.511209:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba5400/0xefc4487a0187952f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016f8 expref: 3559 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.511216:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584527744:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.511231:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.511273:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584527680:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.511282:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ff expref: 5947 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.511289:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2d00, rc 0) 00000100:00100000:1.0:1705683932.511300:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5947:16415:x1788538641057728:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 834us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.511305:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921023 00000100:00100000:1.0:1705683932.511335:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.511338:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba6800/0xefc4487a0187954b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30170d expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.511347:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.511353:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.511354:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.511356:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba6800/0xefc4487a0187954b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30170d expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.511360:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.511361:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba6800/0xefc4487a0187954b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30170d expref: 3560 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.511361:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.511364:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6800, rc 0) 00000100:00100000:3.0:1705683932.511365:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641057984 00010000:00010000:3.0:1705683932.511373:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.511376:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:6496:x1788538641057920:12345-192.168.203.41@tcp:101:dd.0 Request processed in 180us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.511379:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921025 00000100:00100000:3.0:1705683932.511386:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511386:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511389:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333094 00000100:00100000:3.0:1705683932.511391:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:1856:x1788538641057984:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.511394:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.511396:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.511400:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.511413:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba93200/0xefc4487a01821dde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da360 expref: 3984 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.511426:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.511427:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.511427:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.511429:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ff expref: 5946 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.511434:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ff expref: 5946 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.511448:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2d00/0xefc4487a0187953d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3016ff expref: 5946 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.511456:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584527808:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.511475:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.511482:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511484:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511487:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058048 00000100:00100000:1.0:1705683932.511495:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.511504:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511505:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511508:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058112 00000100:00100000:1.0:1705683932.511511:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511512:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511515:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511516:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511516:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511517:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.511517:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921026 00000100:00100000:1.0:1705683932.511522:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3984:4708:x1788538641058048:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.511522:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921027 00000100:00100000:3.0:1705683932.511525:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:7259:x1788538641058112:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.511528:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.511530:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.511579:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.511589:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511590:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511593:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058176 00010000:00010000:1.0:1705683932.511598:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301714 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.511604:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.511604:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800737ce580/0xefc4487a01879559 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x870f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30171b expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.511605:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511608:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921028 00010000:00010000:1.0:1705683932.511610:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5947 pid: 15106 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.511611:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5947:16443:x1788538641058176:12345-192.168.203.41@tcp:101:dir_create.sh.0 00002000:00010000:3.0:1705683932.511614:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x870f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.511616:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.511618:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.511619:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.511621:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301714 expref: 3985 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.511622:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.511623:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.511626:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800737ce580/0xefc4487a01879559 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30171b expref: 3561 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.511633:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5947 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.511637:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800737ce580/0xefc4487a01879559 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x870f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30171b expref: 3561 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.511640:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5947 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.511643:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800737ce580, rc 0) 00000100:00100000:1.0:1705683932.511647:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584527872:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.511658:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3561:7259:x1788538641058112:12345-192.168.203.41@tcp:101:dd.0 Request processed in 132us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.511662:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921027 00000100:00100000:1.0:1705683932.511664:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.511779:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301722 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.511792:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3985 pid: 14249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.511797:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.511798:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.511799:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301722 expref: 5948 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.511803:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.511811:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3985 pid: 14249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.511818:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3985 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.511822:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511824:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.511825:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009b07ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584527936:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.511829:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058240 00000100:00100000:0.0:1705683932.511840:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.511841:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511842:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.511845:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921029 00000100:00100000:3.0:1705683932.511848:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:6521:x1788538641058240:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.511854:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.512121:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e3b700/0xefc4487a01879567 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301729 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.512129:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.512136:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.512136:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.512138:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3b700/0xefc4487a01879567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301729 expref: 5950 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.512143:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e3b700/0xefc4487a01879567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301729 expref: 5950 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.512149:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3b700, rc 0) 00000100:00100000:3.0:1705683932.512169:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5950:6521:x1788538641058240:12345-192.168.203.41@tcp:101:dd.0 Request processed in 320us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.512172:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921029 00000100:00100000:0.0:1705683932.512458:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.512468:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584527744:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.512476:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584527808:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.512477:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.512486:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.512494:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:1854:x1788538641057856:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1335us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.512499:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333093 00000100:00100000:3.0:1705683932.512499:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3985:1856:x1788538641057984:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1107us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.512504:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333094 00000100:00100000:0.0:1705683932.512506:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.512516:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512517:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512521:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058304 00000100:00100000:3.0:1705683932.512532:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512532:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512534:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058368 00000100:00100000:3.0:1705683932.512539:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512539:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512541:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921030 00000100:00100000:3.0:1705683932.512543:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3986:6554:x1788538641058304:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.512545:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.512546:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.512547:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.512553:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921031 00000100:00100000:1.0:1705683932.512557:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3986:6496:x1788538641058368:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.512564:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.512590:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301730 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.512599:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3987 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.512603:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.512603:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.512604:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301730 expref: 3987 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.512613:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3987 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.512617:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3987 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.512622:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584528000:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.512639:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.512819:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.512825:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0c80/0xefc4487a01879575 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301737 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.512830:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512831:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:1.0:1705683932.512835:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9219:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.512835:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058432 00010000:00010000:1.0:1705683932.512844:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.512845:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.512846:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.512847:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0c80/0xefc4487a01879575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301737 expref: 3988 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.512847:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.512850:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921032 00000100:00100000:3.0:1705683932.512851:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3483:6521:x1788538641058432:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.512854:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0c80/0xefc4487a01879575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301737 expref: 3988 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.512856:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.512860:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c0c80, rc 0) 00000100:00100000:0.0:1705683932.512868:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.512878:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:6496:x1788538641058368:12345-192.168.203.41@tcp:101:dd.0 Request processed in 321us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.512879:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.512880:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.512882:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921031 00000100:00100000:0.0:1705683932.512885:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058496 00000100:00100000:1.0:1705683932.512893:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.512893:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.512897:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.512897:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.512897:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921033 00000100:00100000:1.0:1705683932.512900:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:7259:x1788538641058496:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.512905:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.512937:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009b07ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584527936:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.512947:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301722 expref: 5949 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.512955:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6a80, rc 0) 00000100:00100000:0.0:1705683932.513014:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:16443:x1788538641058176:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1402us (1436us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.513016:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0a00/0xefc4487a0187957c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9651:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301745 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.513018:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921028 00002000:00010000:1.0:1705683932.513025:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9651:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.513032:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.513033:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.513035:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.513036:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0a00/0xefc4487a0187957c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301745 expref: 3989 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513048:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c0a00/0xefc4487a0187957c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301745 expref: 3989 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513053:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c0a00, rc 0) 00000100:00100000:1.0:1705683932.513061:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513061:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513065:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058624 00000100:00100000:0.0:1705683932.513069:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.513091:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3990 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.513103:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513104:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.513104:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.513105:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513107:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058560 00000100:00100000:3.0:1705683932.513109:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333095 00000100:00100000:3.0:1705683932.513112:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:1856:x1788538641058624:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.513114:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5949 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.513116:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.513119:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3990 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.513122:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513123:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513126:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333096 00010000:00010000:3.0:1705683932.513126:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3990 pid: 14249 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.513129:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:1856:x1788538641058560:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.513134:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.513136:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0264280/0xefc4487a017f8b83 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2bf expref: 3990 pid: 14249 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.513142:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5949 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.513143:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.513143:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.513145:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301722 expref: 5949 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513148:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5949 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.513149:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301722 expref: 5949 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.513157:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099ba6a80/0xefc4487a01879560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301722 expref: 5949 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513161:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.513161:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584528064:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.513162:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.513164:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301714 expref: 3989 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513169:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301714 expref: 3989 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.513179:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.513183:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301714 expref: 3989 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.513187:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e39400/0xefc4487a01879583 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30173e expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.513190:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584528128:192.168.203.41@tcp:105: 00002000:00010000:3.0:1705683932.513194:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.513199:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.513199:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.513202:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e39400/0xefc4487a01879583 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30173e expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.513206:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e39400/0xefc4487a01879583 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30173e expref: 3484 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.513210:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.513210:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e39400, rc 0) 00000100:00100000:3.0:1705683932.513219:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3484:6521:x1788538641058432:12345-192.168.203.41@tcp:101:dd.0 Request processed in 366us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.513222:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921032 00010000:00010000:1.0:1705683932.513229:0:14216:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391d6080/0xefc4487a01847b26 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd11 expref: 5949 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.513237:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584527872:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.513237:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584528000:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.513245:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301730 expref: 3989 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513248:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2800/0xefc4487a01879552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301714 expref: 3989 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.513249:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3a080, rc 0) 00010000:00010000:1.0:1705683932.513254:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2800, rc 0) 00000100:00100000:3.0:1705683932.513257:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:6554:x1788538641058304:12345-192.168.203.41@tcp:101:dd.0 Request processed in 713us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.513259:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921030 00000100:00100000:1.0:1705683932.513276:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:4708:x1788538641058048:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1754us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.513282:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921026 00000100:00100000:0.0:1705683932.513288:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.513290:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513291:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513294:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058688 00000100:00100000:1.0:1705683932.513306:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513306:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.513306:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.513307:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513310:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921034 00000100:00100000:1.0:1705683932.513313:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3484:16415:x1788538641058688:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.513318:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.513383:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.513422:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30174c expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513433:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3559 pid: 15181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513438:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.513439:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.513441:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30174c expref: 3485 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513453:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3559 pid: 15181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513459:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3559 pid: 15181 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.513466:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584528192:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.513484:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.513492:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513493:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513498:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058752 00010000:00010000:1.0:1705683932.513507:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3988 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.513517:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513518:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513521:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333097 00000100:00100000:1.0:1705683932.513523:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b078500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:1857:x1788538641058752:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.513527:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.513534:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3988 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.513539:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3988 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.513549:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9900/0xefc4487a0186365d lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9525:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb289 expref: 3988 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.513556:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.513557:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.513558:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301730 expref: 3987 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513563:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301730 expref: 3987 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.513574:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584528064:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.513576:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e3a080/0xefc4487a0187956e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9525:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301730 expref: 3987 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.513580:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.513582:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584528256:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.513589:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3987:1856:x1788538641058624:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 477us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.513592:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333095 00000100:00100000:1.0:1705683932.513599:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.513618:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584528128:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.513629:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.513641:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5948:1856:x1788538641058560:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 511us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.513646:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333096 00000100:00100000:1.0:1705683932.513664:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3986:7259:x1788538641058496:12345-192.168.203.41@tcp:101:dd.0 Request processed in 764us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.513668:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921033 00000100:00100000:0.0:1705683932.513839:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.513853:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.513854:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513856:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513861:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058816 00000100:00100000:1.0:1705683932.513881:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584528192:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.513891:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30174c expref: 3485 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.513898:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c0f00, rc 0) 00000100:00100000:1.0:1705683932.513914:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3485:16415:x1788538641058688:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 600us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.513919:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921034 00000100:00100000:1.0:1705683932.513926:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513927:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513929:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058880 00000100:00100000:1.0:1705683932.513939:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513940:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.513942:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921035 00000100:00100000:1.0:1705683932.513945:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b078a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3485:16443:x1788538641058880:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.513950:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.514123:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30175a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514134:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3560 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514139:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.514139:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.514141:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30175a expref: 3486 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514153:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3560 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514157:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3560 pid: 15110 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.514163:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584528320:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.514181:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.514182:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.514190:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514191:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514199:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514200:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514203:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641058944 00000100:00100000:1.0:1705683932.514211:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514212:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514215:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921036 00000100:00100000:3.0:1705683932.514216:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.514218:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514219:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b079400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3560:6496:x1788538641058816:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.514222:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921037 00010000:00010000:1.0:1705683932.514224:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.514225:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5948:6521:x1788538641058944:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.514230:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.514294:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.514304:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.514309:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514310:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514314:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059072 00000100:00100000:0.0:1705683932.514327:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514328:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514331:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921038 00000100:00100000:0.0:1705683932.514334:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3561:6554:x1788538641059072:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.514340:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.514420:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301768 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.514422:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584528256:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.514433:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.514434:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3562 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.514439:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.514440:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.514441:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301768 expref: 3562 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.514445:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b078500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3985:1857:x1788538641058752:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 920us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.514449:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333097 00010000:00010000:0.0:1705683932.514453:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3562 pid: 15181 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.514458:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3562 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.514458:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514459:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514461:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059008 00000100:00100000:0.0:1705683932.514465:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009b07df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584528384:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.514468:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3563 pid: 15181 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.514477:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514477:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514480:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333098 00000100:00100000:0.0:1705683932.514481:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.514482:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b079900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3563:1855:x1788538641059008:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.514487:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.514489:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3563 pid: 15181 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.514495:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3563 pid: 15181 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.514502:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.514505:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801332f1900/0xefc4487a018220e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da424 expref: 3563 pid: 15181 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.514518:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.514519:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.514521:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30174c expref: 3486 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514525:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30174c expref: 3486 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514539:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0f00/0xefc4487a0187958a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30174c expref: 3486 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.514546:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584528448:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.514553:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.514559:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.514560:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.514560:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514563:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514564:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.514565:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059136 00000100:00100000:0.0:1705683932.514568:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059200 00010000:00010000:1.0:1705683932.514574:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3480/0xefc4487a0187959f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301753 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.514579:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.514580:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514582:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.514583:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:1.0:1705683932.514583:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.514585:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921039 00000100:00100000:3.0:1705683932.514588:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:7259:x1788538641059136:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.514589:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921040 00010000:00010000:1.0:1705683932.514590:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.514591:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.514592:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b07f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:4708:x1788538641059200:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.514593:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3480/0xefc4487a0187959f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301753 expref: 3565 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.514594:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.514599:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.514599:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3480/0xefc4487a0187959f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301753 expref: 3565 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.514604:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c3480, rc 0) 00000100:00100000:1.0:1705683932.514613:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b079400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:6496:x1788538641058816:12345-192.168.203.41@tcp:101:dd.0 Request processed in 393us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.514616:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921036 00010000:00010000:0.0:1705683932.514644:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301776 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.514655:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3486 pid: 15123 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.514660:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.514661:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.514663:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301776 expref: 3565 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.514674:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3486 pid: 15123 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.514678:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3486 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.514683:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b3200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584528512:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.514695:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.514787:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e3b980/0xefc4487a018795ad lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30176f expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.514795:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.514802:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.514802:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.514804:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e3b980/0xefc4487a018795ad lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30176f expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.514809:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e3b980/0xefc4487a018795ad lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30176f expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.514813:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3b980, rc 0) 00000100:00100000:3.0:1705683932.514827:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:7259:x1788538641059136:12345-192.168.203.41@tcp:101:dd.0 Request processed in 240us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.514831:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921039 00010000:00010000:3.0:1705683932.514842:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e39e00/0xefc4487a018795b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x937f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301761 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.514849:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x937f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.514853:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.514854:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.514855:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e39e00/0xefc4487a018795b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301761 expref: 5949 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.514860:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e39e00/0xefc4487a018795b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x937f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301761 expref: 5949 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.514862:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e39e00, rc 0) 00000100:00100000:3.0:1705683932.514871:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:6521:x1788538641058944:12345-192.168.203.41@tcp:101:dd.0 Request processed in 647us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.514873:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921037 00000100:00100000:1.0:1705683932.515141:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584528320:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.515152:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30175a expref: 3486 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515159:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c3980, rc 0) 00000100:00100000:1.0:1705683932.515175:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b078a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3486:16443:x1788538641058880:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1229us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.515180:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921035 00000100:00100000:1.0:1705683932.515200:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009b07df00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584528384:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.515208:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301768 expref: 3565 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515214:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ba6d00, rc 0) 00000100:00100000:1.0:1705683932.515228:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:6554:x1788538641059072:12345-192.168.203.41@tcp:101:dd.0 Request processed in 894us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.515232:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921038 00000100:00100000:0.0:1705683932.515366:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b3200 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584528512:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.515377:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301776 expref: 3564 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.515384:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d7200, rc 0) 00000100:00100000:1.0:1705683932.515384:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cdf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584528448:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.515395:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.515406:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b079900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3564:1855:x1788538641059008:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 923us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.515411:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333098 00000100:00100000:1.0:1705683932.515434:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.515442:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515443:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515446:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059456 00000100:00100000:1.0:1705683932.515455:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.515456:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b07f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3563:4708:x1788538641059200:12345-192.168.203.41@tcp:101:dd.0 Request processed in 862us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.515456:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515458:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921041 00000100:00100000:0.0:1705683932.515462:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921040 00000100:00100000:1.0:1705683932.515462:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3486:6521:x1788538641059456:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.515467:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.515492:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.515518:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.515542:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.515555:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.515560:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.515561:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.515564:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059520 00000100:00100000:0.0:1705683932.515577:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.515577:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.515579:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921042 00000100:00100000:0.0:1705683932.515581:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3985:6496:x1788538641059520:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.515641:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.515647:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515648:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515652:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059328 00010000:00010000:1.0:1705683932.515660:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3563 pid: 15110 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.515672:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515673:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515675:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059264 00000100:00100000:3.0:1705683932.515676:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.515678:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.515680:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3564 pid: 15181 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.515683:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059392 00010000:00010000:3.0:1705683932.515695:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3487 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.515698:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515699:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515703:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333099 00000100:00100000:1.0:1705683932.515706:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b3200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3564:1854:x1788538641059328:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.515722:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.515723:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.515723:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.515726:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3564 pid: 15110 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.515726:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333100 00000100:00100000:3.0:1705683932.515729:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4297050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3564:1855:x1788538641059264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.515733:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3564 pid: 15110 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.515735:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.515744:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3564 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.515747:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae30c80/0xefc4487a017f8ca2 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc2fe expref: 3564 pid: 15110 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.515753:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3563 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.515754:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515755:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515757:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30175a expref: 3487 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515761:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30175a expref: 3487 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.515762:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b9680/0xefc4487a01863664 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb290 expref: 3563 pid: 15181 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.515768:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.515769:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.515771:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301768 expref: 3562 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515775:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f1c3980/0xefc4487a01879591 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30175a expref: 3487 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.515775:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301768 expref: 3562 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.515781:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584528576:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.515786:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ba6d00/0xefc4487a01879598 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301768 expref: 3562 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.515791:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584528640:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.515799:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.515807:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515808:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.515808:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.515814:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333101 00000100:00100000:3.0:1705683932.515816:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.515817:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.515818:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3487:1855:x1788538641059392:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.515823:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.515832:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3487 pid: 15123 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.515837:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3487 pid: 15123 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.515848:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f5c280/0xefc4487a01847abd lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd18 expref: 3487 pid: 15123 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.515858:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515859:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515861:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301776 expref: 3562 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515865:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301776 expref: 3562 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515880:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801391d7200/0xefc4487a018795a6 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301776 expref: 3562 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.515886:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584528704:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.515900:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d6a80/0xefc4487a018795bb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301784 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.515903:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00002000:00010000:0.0:1705683932.515914:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.515917:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1b80/0xefc4487a018795c2 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30177d expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.515922:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.515923:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.515926:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d6a80/0xefc4487a018795bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301784 expref: 3986 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.515927:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.515933:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d6a80/0xefc4487a018795bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301784 expref: 3986 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515934:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515935:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.515938:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1b80/0xefc4487a018795c2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30177d expref: 3487 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.515939:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d6a80, rc 0) 00010000:00010000:1.0:1705683932.515944:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1b80/0xefc4487a018795c2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30177d expref: 3487 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.515949:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1b80, rc 0) 00000100:00100000:0.0:1705683932.515953:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b7300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3986:6496:x1788538641059520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 370us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.515958:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921042 00000100:00100000:1.0:1705683932.515961:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3487:6521:x1788538641059456:12345-192.168.203.41@tcp:101:dd.0 Request processed in 499us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.515966:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921041 00000100:00100000:1.0:1705683932.515997:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.516007:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.516008:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.516012:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059584 00000100:00100000:1.0:1705683932.516030:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.516031:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516032:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516033:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.516034:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921043 00000100:00100000:1.0:1705683932.516037:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3986:7259:x1788538641059584:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.516042:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.516071:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.516091:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516092:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516095:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059648 00000100:00100000:0.0:1705683932.516105:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516106:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.516109:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921044 00000100:00100000:0.0:1705683932.516112:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800734b4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5949:16415:x1788538641059648:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.516118:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.516172:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3700/0xefc4487a018795c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9652:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30178b expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.516182:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9652:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.516190:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.516191:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.516193:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3700/0xefc4487a018795c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30178b expref: 3987 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.516200:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3700/0xefc4487a018795c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30178b expref: 3987 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.516205:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c3700, rc 0) 00000100:00100000:1.0:1705683932.516218:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3987:7259:x1788538641059584:12345-192.168.203.41@tcp:101:dd.0 Request processed in 180us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.516222:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921043 00010000:00010000:0.0:1705683932.516354:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301792 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.516367:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3986 pid: 15106 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.516372:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.516373:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.516375:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301792 expref: 5950 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.516387:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3986 pid: 15106 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.516393:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3986 pid: 15106 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.516400:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800734b6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584528768:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.516426:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.517248:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584528576:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.517250:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.517258:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.517260:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584528640:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.517263:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.517272:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.517275:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b3200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3562:1854:x1788538641059328:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1569us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.517278:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.517280:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333099 00000100:00100000:3.0:1705683932.517287:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4297050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3561:1855:x1788538641059264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1558us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.517295:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333100 00000100:00100000:1.0:1705683932.517300:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584528704:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.517311:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.517324:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b0500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3486:1855:x1788538641059392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1505us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.517328:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517329:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333101 00000100:00100000:3.0:1705683932.517329:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517343:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517344:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517349:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059712 00000100:00100000:1.0:1705683932.517350:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059776 00000100:00100000:3.0:1705683932.517360:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517360:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517362:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059840 00000100:00100000:1.0:1705683932.517374:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.517375:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.517375:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517376:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517376:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517379:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921045 00000100:00100000:3.0:1705683932.517381:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059904 00000100:00100000:1.0:1705683932.517383:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3562:7259:x1788538641059712:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.517384:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.517385:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.517389:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.517390:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517391:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.517392:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921046 00000100:00100000:0.0:1705683932.517396:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5951:6521:x1788538641059776:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.517397:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921047 00000100:00100000:3.0:1705683932.517401:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3562:6496:x1788538641059904:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.517402:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.517408:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.517554:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1900/0xefc4487a018795d7 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301799 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.517564:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.517573:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517574:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517577:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1900/0xefc4487a018795d7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301799 expref: 3563 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.517584:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1900/0xefc4487a018795d7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301799 expref: 3563 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.517590:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1900, rc 0) 00000100:00100000:1.0:1705683932.517603:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3563:7259:x1788538641059712:12345-192.168.203.41@tcp:101:dd.0 Request processed in 220us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.517608:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921045 00010000:00010000:3.0:1705683932.517613:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e3bc00/0xefc4487a018795de lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017ae expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.517623:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.517631:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.517632:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.517634:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e3bc00/0xefc4487a018795de lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ae expref: 3563 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.517635:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d4500/0xefc4487a018795e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017a0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.517641:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e3bc00/0xefc4487a018795de lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ae expref: 3563 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.517644:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.517645:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3bc00, rc 0) 00010000:00010000:0.0:1705683932.517651:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.517652:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.517654:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d4500/0xefc4487a018795e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a0 expref: 5952 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.517658:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3563:6496:x1788538641059904:12345-192.168.203.41@tcp:101:dd.0 Request processed in 258us (284us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.517660:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d4500/0xefc4487a018795e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a0 expref: 5952 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.517662:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921047 00010000:00010000:0.0:1705683932.517664:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d4500, rc 0) 00000100:00100000:0.0:1705683932.517677:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:6521:x1788538641059776:12345-192.168.203.41@tcp:101:dd.0 Request processed in 281us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.517677:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517678:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517680:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921048 00000100:00100000:3.0:1705683932.517682:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3987:6554:x1788538641059840:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.517686:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.517687:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921046 00000100:00100000:0.0:1705683932.517717:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.517731:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.517731:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017a7 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.517741:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517742:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517744:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641059968 00000100:00100000:1.0:1705683932.517746:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517747:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517752:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060032 00000100:00100000:3.0:1705683932.517752:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.517753:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800734b6e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584528768:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.517753:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.517755:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921049 00000100:00100000:3.0:1705683932.517757:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:16443:x1788538641059968:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.517761:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.517765:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301792 expref: 5952 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.517766:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517766:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517770:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921050 00010000:00010000:0.0:1705683932.517773:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d7700, rc 0) 00000100:00100000:1.0:1705683932.517773:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:4708:x1788538641060032:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.517778:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.517786:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800734b4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:16415:x1788538641059648:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1673us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.517790:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921044 00010000:00010000:1.0:1705683932.517810:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017bc expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.517822:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5951 pid: 14405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.517826:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517827:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517829:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017bc expref: 3990 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.517845:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.517846:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5951 pid: 14405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.517851:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5951 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.517860:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584528832:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.517866:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517867:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517871:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060096 00010000:00010000:1.0:1705683932.517879:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3991 pid: 15106 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.517898:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517899:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.517902:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333102 00000100:00100000:1.0:1705683932.517905:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:1856:x1788538641060096:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.517910:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.517913:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3991 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.517918:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3991 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.517929:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800959a8500/0xefc4487a0182241a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da4f6 expref: 3991 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.517938:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517938:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.517940:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301792 expref: 5951 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.517945:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301792 expref: 5951 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.517945:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017b5 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.517955:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3990 pid: 15149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.517959:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d7700/0xefc4487a018795d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301792 expref: 5952 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.517959:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.517960:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.517961:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017b5 expref: 5952 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.517965:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584528896:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.517976:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3990 pid: 15149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.517981:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3990 pid: 15149 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.517984:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.517986:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584528960:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.518002:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.518004:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.518013:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3990 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.518016:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518017:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518018:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a7 expref: 3990 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.518025:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3990 pid: 15171 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.518028:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3990 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.518032:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584529024:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.518043:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.518403:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.518424:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584528896:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.518429:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.518434:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.518452:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:1856:x1788538641060096:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 546us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.518453:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518454:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518456:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333102 00000100:00100000:3.0:1705683932.518459:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060224 00000100:00100000:1.0:1705683932.518471:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518472:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518473:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518474:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518476:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060160 00000100:00100000:3.0:1705683932.518479:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921051 00000100:00100000:3.0:1705683932.518481:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3486:6521:x1788538641060224:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.518486:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.518487:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518488:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518491:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921052 00000100:00100000:1.0:1705683932.518494:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:7259:x1788538641060160:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.518499:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.518573:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.518635:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.518670:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.518746:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345d180/0xefc4487a01879601 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017ca expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.518755:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.518761:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518762:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518764:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345d180/0xefc4487a01879601 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ca expref: 3487 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.518768:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.518769:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345d180/0xefc4487a01879601 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ca expref: 3487 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.518773:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345d180, rc 0) 00000100:00100000:1.0:1705683932.518777:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518778:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518782:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060416 00000100:00100000:3.0:1705683932.518787:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3487:6521:x1788538641060224:12345-192.168.203.41@tcp:101:dd.0 Request processed in 305us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.518791:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921051 00010000:00010000:1.0:1705683932.518792:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3991 pid: 15149 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.518802:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518803:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518803:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518804:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518805:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060480 00000100:00100000:3.0:1705683932.518807:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060544 00010000:00010000:1.0:1705683932.518812:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5953 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.518814:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3992 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.518821:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518821:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.518825:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333103 00000100:00100000:3.0:1705683932.518825:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.518826:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518826:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.518827:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518828:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333104 00000100:00100000:1.0:1705683932.518829:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1854:x1788538641060416:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.518833:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333105 00000100:00100000:3.0:1705683932.518833:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5953:1857:x1788538641060480:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.518834:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.518836:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1854:x1788538641060544:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.518836:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3992 pid: 15149 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.518837:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.518841:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.518842:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3992 pid: 15149 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.518845:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5953 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.518849:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3992 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.518849:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5953 pid: 14405 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.518852:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.518853:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.518854:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3992 pid: 15171 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.518856:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017b5 expref: 5953 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.518859:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518860:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.518861:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017bc expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.518862:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.518863:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.518865:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a7 expref: 3992 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.518865:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017b5 expref: 5953 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.518865:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017bc expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.518868:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a7 expref: 3992 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.518876:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017bc expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.518879:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a7 expref: 3992 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.518879:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017b5 expref: 5953 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.518882:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584529088:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.518883:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584529216:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.518886:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584529152:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.518898:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.518902:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.518911:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.518916:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518918:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518923:0:14222:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060352 00010000:00010000:1.0:1705683932.518933:0:15095:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008497c780/0xefc4487a01847ad2 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd1f expref: 5953 pid: 14405 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.518941:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584528832:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.518942:0:14222:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518943:0:14222:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.518948:0:14222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413479 00000100:00100000:3.0:1705683932.518951:0:14222:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1938:7381:x1788538641060352:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1705683932.518953:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c2f80/0xefc4487a018795f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017bc expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.518958:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2f80, rc 0) 00010000:00010000:3.0:1705683932.518961:0:14222:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.518974:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:4708:x1788538641060032:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1201us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.518979:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921050 00010000:00010000:1.0:1705683932.518993:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1180/0xefc4487a01879608 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9653:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017c3 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.519002:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9653:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.519010:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.519011:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.519013:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1180/0xefc4487a01879608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017c3 expref: 3992 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.519019:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1180/0xefc4487a01879608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017c3 expref: 3992 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.519024:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1180, rc 0) 00000100:00100000:1.0:1705683932.519034:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:7259:x1788538641060160:12345-192.168.203.41@tcp:101:dd.0 Request processed in 540us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.519038:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921052 00010000:00010000:3.0:1705683932.519062:0:14222:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007345d900/0xefc4487a0187960f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017d1 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.519087:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.519100:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.519101:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.519105:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060608 00000100:00100000:1.0:1705683932.519117:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.519117:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.519120:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921053 00000100:00100000:1.0:1705683932.519123:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3487:16415:x1788538641060608:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.519128:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1705683932.519175:0:14222:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x422f:0x0]: returning size 4096 00010000:00010000:1.0:1705683932.519249:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017d8 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.519260:0:14222:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007345d900/0xefc4487a0187960f lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d1 expref: 1940 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.519262:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3562 pid: 14248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.519265:0:14222:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007345d900/0xefc4487a0187960f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d1 expref: 1940 pid: 14222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.519267:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.519268:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.519269:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d8 expref: 3488 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.519275:0:14222:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345d900, rc 0) 00010000:00010000:1.0:1705683932.519286:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3562 pid: 14248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.519290:0:14222:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1939:7381:x1788538641060352:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 339us (717us total) trans 4295085013 rc 301/301 00010000:00010000:1.0:1705683932.519292:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3562 pid: 14248 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.519293:0:14222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413479 00000100:00100000:1.0:1705683932.519299:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584529280:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.519316:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.519316:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ebe300/0xefc4487a017f8df2 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc32f expref: 3991 pid: 15149 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.519322:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584528960:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.519330:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e3b480/0xefc4487a018795fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x733f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017b5 expref: 5952 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.519338:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3b480, rc 0) 00000100:00100000:3.0:1705683932.519349:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:16443:x1788538641059968:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1591us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.519351:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921049 00010000:00010000:3.0:1705683932.519367:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095109e00/0xefc4487a0186366b lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9526:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb297 expref: 3990 pid: 15171 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.519371:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584529024:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.519377:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e3a300/0xefc4487a018795ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x9526:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017a7 expref: 3989 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.519381:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e3a300, rc 0) 00000100:00100000:3.0:1705683932.519391:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:6554:x1788538641059840:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1708us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.519393:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921048 00000100:00100000:0.0:1705683932.519845:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.519857:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.519867:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519868:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519872:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060672 00000100:00100000:0.0:1705683932.519887:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.519889:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584529088:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.519895:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.519897:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.519907:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584529216:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.519913:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5951:1857:x1788538641060480:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1081us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.519915:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.519916:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.519916:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333104 00000100:00100000:3.0:1705683932.519928:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519929:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.519930:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:1854:x1788538641060544:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1093us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.519931:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060736 00000100:00100000:1.0:1705683932.519935:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333105 00000100:00100000:3.0:1705683932.519936:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519937:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519938:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060800 00000100:00100000:3.0:1705683932.519945:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519945:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519946:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060864 00000100:00100000:3.0:1705683932.519953:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519954:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519955:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060928 00000100:00100000:1.0:1705683932.519959:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584529152:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.519962:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519963:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.519967:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921054 00010000:00010000:1.0:1705683932.519969:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.519969:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5951:6521:x1788538641060736:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.519973:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.519983:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:1854:x1788538641060416:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1154us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.519988:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333103 00000100:00100000:1.0:1705683932.520003:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520004:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520010:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921055 00000100:00100000:1.0:1705683932.520013:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:7259:x1788538641060800:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.520019:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.520152:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584529280:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.520161:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d8 expref: 3488 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.520167:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2080, rc 0) 00000100:00100000:0.0:1705683932.520216:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3488:16415:x1788538641060608:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1055us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.520220:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921053 00000100:00100000:0.0:1705683932.520227:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.520228:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.520231:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921056 00000100:00100000:0.0:1705683932.520233:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:6554:x1788538641060864:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.520235:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0500/0xefc4487a01879624 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017ed expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.520237:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1705683932.520245:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.520252:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.520253:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345f200/0xefc4487a0187962b lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017e6 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.520254:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.520256:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0500/0xefc4487a01879624 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ed expref: 3566 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.520262:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c0500/0xefc4487a01879624 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017ed expref: 3566 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.520265:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.520266:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017f4 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.520267:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c0500, rc 0) 00010000:00010000:3.0:1705683932.520273:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.520274:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.520275:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3567 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.520277:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345f200/0xefc4487a0187962b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017e6 expref: 5952 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.520278:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.520279:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.520279:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:7259:x1788538641060800:12345-192.168.203.41@tcp:101:dd.0 Request processed in 265us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.520280:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017f4 expref: 3567 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.520283:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921055 00010000:00010000:3.0:1705683932.520284:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345f200/0xefc4487a0187962b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017e6 expref: 5952 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.520288:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3566 pid: 15147 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.520290:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.520290:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345f200, rc 0) 00000100:00100000:1.0:1705683932.520291:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.520292:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3566 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.520295:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921057 00000100:00100000:0.0:1705683932.520296:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090418a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584529344:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.520298:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:4708:x1788538641060928:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.520302:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.520305:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:6521:x1788538641060736:12345-192.168.203.41@tcp:101:dd.0 Request processed in 335us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.520309:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.520309:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921054 00000100:00100000:0.0:1705683932.520324:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.520326:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.520327:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.520329:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921058 00000100:00100000:3.0:1705683932.520331:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3987:6496:x1788538641060672:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.520335:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.520340:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.520344:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017fb expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.520355:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3487 pid: 8804 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.520360:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.520361:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.520362:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017fb expref: 3567 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.520374:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3487 pid: 8804 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.520380:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3487 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.520381:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.520389:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584529408:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.520397:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520398:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520404:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061120 00000100:00100000:1.0:1705683932.520420:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520421:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.520424:0:6535:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520424:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107578 00000100:00100000:0.0:1705683932.520425:0:6535:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520427:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1939:7381:x1788538641061120:12345-192.168.203.41@tcp:33:lfs.0 00000004:00200000:1.0:1705683932.520497:0:14260:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x422f:0x0]: returning size 4096 00000004:00200000:1.0:1705683932.520500:0:14260:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1705683932.520532:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1939:7381:x1788538641061120:12345-192.168.203.41@tcp:33:lfs.0 Request processed in 103us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.520536:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107578 00000100:00100000:1.0:1705683932.520549:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520550:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520553:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641060992 00010000:00010000:1.0:1705683932.520560:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3568 pid: 14248 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.520574:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520575:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.520578:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.520578:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520578:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333106 00000100:00100000:1.0:1705683932.520581:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:1854:x1788538641060992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.520586:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.520588:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3568 pid: 14248 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.520593:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3568 pid: 14248 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.520604:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133d6ca00/0xefc4487a0182270e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da5a5 expref: 3568 pid: 14248 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.520604:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.520605:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.520609:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061056 00010000:00010000:1.0:1705683932.520611:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.520612:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.520614:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d8 expref: 3488 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.520617:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.520617:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.520620:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d8 expref: 3488 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.520620:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921059 00000100:00100000:3.0:1705683932.520622:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3488:16443:x1788538641061056:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.520625:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.520634:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2080/0xefc4487a0187961d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017d8 expref: 3488 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.520644:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584529472:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.520663:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.520682:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.520816:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.520848:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301802 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.520849:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520850:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520856:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061184 00010000:00010000:3.0:1705683932.520859:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3567 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.520863:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.520864:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.520865:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301802 expref: 3490 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.520869:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520870:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.520874:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921060 00010000:00010000:3.0:1705683932.520875:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3567 pid: 15225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.520876:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3490:6521:x1788538641061184:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.520879:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3567 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.520881:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.520888:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584529536:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.520907:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.520919:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345ea80/0xefc4487a01879647 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3017df expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.520922:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090418a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584529344:192.168.203.41@tcp:104: 00002000:00010000:3.0:1705683932.520927:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.520931:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017f4 expref: 3567 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.520932:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.520932:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.520934:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345ea80/0xefc4487a01879647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017df expref: 3988 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.520937:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d5680, rc 0) 00010000:00010000:3.0:1705683932.520939:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345ea80/0xefc4487a01879647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017df expref: 3988 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.520943:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345ea80, rc 0) 00000100:00100000:0.0:1705683932.520946:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:6554:x1788538641060864:12345-192.168.203.41@tcp:101:dd.0 Request processed in 713us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.520949:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921056 00000100:00100000:3.0:1705683932.520952:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:6496:x1788538641060672:12345-192.168.203.41@tcp:101:dd.0 Request processed in 620us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.520955:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921058 00000100:00100000:0.0:1705683932.520998:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.521018:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521018:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521022:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061248 00000100:00100000:3.0:1705683932.521030:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521030:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521032:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921061 00000100:00100000:3.0:1705683932.521034:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3988:7259:x1788538641061248:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.521038:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.521100:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1400/0xefc4487a0187964e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301809 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.521111:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.521118:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.521119:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.521122:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1400/0xefc4487a0187964e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301809 expref: 3491 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521129:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c1400/0xefc4487a0187964e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301809 expref: 3491 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521135:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1400, rc 0) 00000100:00100000:0.0:1705683932.521137:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.521142:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521142:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521146:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061312 00010000:00010000:0.0:1705683932.521152:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3567 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.521152:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3491:6521:x1788538641061184:12345-192.168.203.41@tcp:101:dd.0 Request processed in 275us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.521160:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521160:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921060 00000100:00100000:0.0:1705683932.521161:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521163:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333107 00000100:00100000:0.0:1705683932.521164:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4dff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:1856:x1788538641061312:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.521168:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.521173:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3567 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.521177:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3567 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.521185:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7de00/0xefc4487a01863672 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb29e expref: 3567 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.521191:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.521192:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.521193:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017f4 expref: 3566 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.521197:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017f4 expref: 3566 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.521198:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584529472:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.521208:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801391d5680/0xefc4487a01879632 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017f4 expref: 3566 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521208:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.521212:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041df00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584529600:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.521218:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:1854:x1788538641060992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 637us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.521223:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.521223:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333106 00000100:00100000:0.0:1705683932.521298:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.521308:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521309:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521314:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061440 00000100:00100000:1.0:1705683932.521332:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521333:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521337:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107579 00000100:00100000:1.0:1705683932.521340:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c76c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1939:7381:x1788538641061440:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1705683932.521380:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.521404:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584529536:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.521413:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301802 expref: 3490 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521418:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345db80, rc 0) 00000100:00100000:3.0:1705683932.521431:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3490:16443:x1788538641061056:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 809us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.521432:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c76c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1940:7381:x1788538641061440:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 90us (134us total) trans 4295085014 rc 0/0 00000100:00100000:3.0:1705683932.521435:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921059 00000100:00100000:1.0:1705683932.521437:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107579 00000100:00100000:3.0:1705683932.521441:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521442:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521444:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061504 00000100:00100000:3.0:1705683932.521457:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521457:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521460:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921062 00000100:00100000:3.0:1705683932.521461:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5952:16415:x1788538641061504:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.521465:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.521519:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.521522:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584529408:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.521533:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017fb expref: 3565 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521540:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c2a80, rc 0) 00000100:00100000:1.0:1705683932.521556:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:4708:x1788538641060928:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1257us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.521560:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921057 00000100:00100000:1.0:1705683932.521574:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521575:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521578:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061632 00010000:00010000:1.0:1705683932.521587:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3565 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.521596:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521597:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521600:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521600:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333108 00000100:00100000:0.0:1705683932.521601:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.521602:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:1856:x1788538641061632:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.521607:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.521609:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3565 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.521615:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3565 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.521626:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013162c280/0xefc4487a017f8fb2 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc383 expref: 3565 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.521635:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.521636:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.521638:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301802 expref: 3489 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521642:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301802 expref: 3489 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.521656:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007345db80/0xefc4487a01879640 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x667f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301802 expref: 3489 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.521663:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584529664:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.521678:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.521782:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301817 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521792:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3988 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521795:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.521796:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.521797:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301817 expref: 5953 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521805:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3988 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521810:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3988 pid: 14234 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.521814:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584529728:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.521834:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.521845:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345c280/0xefc4487a0187965c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9654:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301810 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.521852:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9654:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.521857:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.521858:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.521859:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345c280/0xefc4487a0187965c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301810 expref: 3989 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521864:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345c280/0xefc4487a0187965c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301810 expref: 3989 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521868:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345c280, rc 0) 00000100:00100000:3.0:1705683932.521875:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:7259:x1788538641061248:12345-192.168.203.41@tcp:101:dd.0 Request processed in 840us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.521878:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921061 00000100:00100000:0.0:1705683932.521884:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.521889:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521890:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521893:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061568 00010000:00010000:0.0:1705683932.521900:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3490 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.521911:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521911:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521913:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333109 00000100:00100000:1.0:1705683932.521914:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.521915:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3490:1856:x1788538641061568:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.521915:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.521919:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.521924:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3490 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.521928:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3490 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.521929:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.521937:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c9f480/0xefc4487a01847ac4 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd26 expref: 3490 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.521940:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521940:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.521943:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.521943:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061696 00010000:00010000:0.0:1705683932.521944:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.521945:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017fb expref: 3565 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.521949:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017fb expref: 3565 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.521949:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521950:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.521952:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921063 00000100:00100000:3.0:1705683932.521954:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:6496:x1788538641061696:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.521958:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f1c2a80/0xefc4487a01879639 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3017fb expref: 3565 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.521958:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.521962:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584529792:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.521975:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.521993:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.522003:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522004:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522008:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061760 00000100:00100000:1.0:1705683932.522020:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522020:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522023:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921064 00000100:00100000:1.0:1705683932.522025:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5954:6521:x1788538641061760:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.522031:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.522184:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345ef80/0xefc4487a01879663 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30181e expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.522192:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.522197:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.522198:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.522200:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345ef80/0xefc4487a01879663 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30181e expref: 3566 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.522205:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345ef80/0xefc4487a01879663 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30181e expref: 3566 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.522208:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345ef80, rc 0) 00000100:00100000:3.0:1705683932.522226:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:6496:x1788538641061696:12345-192.168.203.41@tcp:101:dd.0 Request processed in 271us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.522231:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921063 00010000:00010000:1.0:1705683932.522326:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1680/0xefc4487a0187966a lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301825 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.522336:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.522343:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.522344:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.522346:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1680/0xefc4487a0187966a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301825 expref: 5955 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.522353:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c1680/0xefc4487a0187966a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301825 expref: 5955 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.522358:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c1680, rc 0) 00000100:00100000:1.0:1705683932.522372:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:6521:x1788538641061760:12345-192.168.203.41@tcp:101:dd.0 Request processed in 346us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.522376:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921064 00000100:00100000:0.0:1705683932.522482:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041df00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584529600:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.522490:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.522490:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584529664:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.522500:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.522501:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4dff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:1856:x1788538641061312:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1336us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.522504:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333107 00000100:00100000:1.0:1705683932.522512:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3564:1856:x1788538641061632:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 909us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.522517:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333108 00000100:00100000:0.0:1705683932.522532:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.522572:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522573:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522577:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.522577:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061824 00000100:00100000:3.0:1705683932.522582:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584529728:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.522588:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522588:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522590:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061888 00000100:00100000:0.0:1705683932.522592:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584529792:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.522594:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301817 expref: 5955 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.522596:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522597:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.522599:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.522600:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921065 00010000:00010000:3.0:1705683932.522602:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345f980, rc 0) 00000100:00100000:1.0:1705683932.522603:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3989:6554:x1788538641061824:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.522607:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3489:1856:x1788538641061568:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 691us (724us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.522608:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.522610:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333109 00000100:00100000:0.0:1705683932.522617:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522618:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.522619:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:16415:x1788538641061504:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1156us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.522621:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921066 00000100:00100000:0.0:1705683932.522623:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:16443:x1788538641061888:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.522627:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921062 00010000:00010000:0.0:1705683932.522628:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.522647:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30182c expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.522657:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3990 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.522662:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.522662:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.522664:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30182c expref: 3990 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.522678:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3990 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.522683:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3990 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.522689:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301833 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.522689:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584529856:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.522698:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3990 pid: 15226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.522701:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.522702:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.522703:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301833 expref: 5955 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.522703:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.522722:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3990 pid: 15226 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.522726:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3990 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.522731:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584529920:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.522742:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.522756:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.522766:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522767:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522771:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641061952 00000100:00100000:0.0:1705683932.522781:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.522786:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522787:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522789:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062016 00000100:00100000:1.0:1705683932.522790:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522791:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.522794:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921067 00010000:00010000:0.0:1705683932.522797:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3991 pid: 14234 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.522797:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3564:7259:x1788538641061952:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.522803:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.522809:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522809:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.522811:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333110 00000100:00100000:0.0:1705683932.522813:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:1857:x1788538641062016:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.522816:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.522818:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3991 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.522910:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3991 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.522918:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0dcaa80/0xefc4487a01822992 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da64d expref: 3991 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.522924:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.522925:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.522926:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301817 expref: 5955 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.522932:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301817 expref: 5955 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.522942:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007345f980/0xefc4487a01879655 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301817 expref: 5955 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.522946:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584529984:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.522956:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.522977:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.522991:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c896d00/0xefc4487a0187967f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30183a expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.522996:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00002000:00010000:1.0:1705683932.523002:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.523004:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.523005:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.523009:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.523010:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.523010:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062080 00010000:00010000:1.0:1705683932.523013:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c896d00/0xefc4487a0187967f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30183a expref: 3565 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.523019:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c896d00/0xefc4487a0187967f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30183a expref: 3565 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.523026:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c896d00, rc 0) 00000100:00100000:0.0:1705683932.523027:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.523031:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.523032:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.523036:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062144 00000100:00100000:0.0:1705683932.523037:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523038:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523041:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062208 00000100:00100000:1.0:1705683932.523042:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:7259:x1788538641061952:12345-192.168.203.41@tcp:101:dd.0 Request processed in 243us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.523045:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.523046:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921067 00000100:00100000:3.0:1705683932.523046:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523050:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.523050:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921068 00000100:00100000:0.0:1705683932.523051:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523054:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921069 00000100:00100000:1.0:1705683932.523054:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.523054:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:6496:x1788538641062080:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.523055:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523056:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:4708:x1788538641062144:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.523058:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921070 00010000:00010000:3.0:1705683932.523060:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.523061:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3489:6521:x1788538641062208:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.523062:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.523065:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.523120:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301848 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.523129:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.523132:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.523133:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.523134:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301848 expref: 3993 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.523142:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.523145:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.523150:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584530048:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.523160:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.523249:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345e080/0xefc4487a0187968d lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301841 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.523258:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.523264:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.523265:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.523267:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345e080/0xefc4487a0187968d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301841 expref: 3994 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.523271:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c894000/0xefc4487a01879694 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30184f expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.523272:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345e080/0xefc4487a0187968d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301841 expref: 3994 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.523276:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345e080, rc 0) 00002000:00010000:1.0:1705683932.523280:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.523287:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.523288:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.523290:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c894000/0xefc4487a01879694 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30184f expref: 3490 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.523292:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:6496:x1788538641062080:12345-192.168.203.41@tcp:101:dd.0 Request processed in 238us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.523295:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921068 00010000:00010000:1.0:1705683932.523297:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c894000/0xefc4487a01879694 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30184f expref: 3490 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.523301:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c894000, rc 0) 00000100:00100000:1.0:1705683932.523314:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3490:6521:x1788538641062208:12345-192.168.203.41@tcp:101:dd.0 Request processed in 253us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.523318:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921070 00000100:00100000:0.0:1705683932.523788:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584529920:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.523795:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301833 expref: 5955 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.523800:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d7c00, rc 0) 00000100:00100000:1.0:1705683932.523812:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584529856:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.523816:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:16443:x1788538641061888:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1192us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.523819:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921066 00010000:00010000:1.0:1705683932.523824:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30182c expref: 3993 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.523831:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f1c3c00, rc 0) 00000100:00100000:0.0:1705683932.523841:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584530048:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.523845:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3993:6554:x1788538641061824:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1241us (1312us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.523847:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301848 expref: 3993 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.523850:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921065 00010000:00010000:0.0:1705683932.523851:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d4f00, rc 0) 00000100:00100000:0.0:1705683932.523858:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:4708:x1788538641062144:12345-192.168.203.41@tcp:101:dd.0 Request processed in 802us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.523861:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921069 00000100:00100000:0.0:1705683932.523890:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.523894:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523894:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523896:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062272 00000100:00100000:1.0:1705683932.523898:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584529984:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.523903:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523903:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.523905:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921071 00000100:00100000:0.0:1705683932.523907:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:7259:x1788538641062272:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.523907:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.523910:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.523919:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1857:x1788538641062016:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1105us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.523924:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333110 00000100:00100000:1.0:1705683932.524140:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.524149:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524149:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524153:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062400 00010000:00010000:1.0:1705683932.524161:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3992 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.524170:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524171:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524173:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333111 00000100:00100000:1.0:1705683932.524176:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1854:x1788538641062400:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.524181:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.524183:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3992 pid: 15226 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.524193:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d7980/0xefc4487a0187969b lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9655:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301856 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524193:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3992 pid: 15226 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1705683932.524201:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9655:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.524203:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b131180/0xefc4487a017f90ed lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc3e5 expref: 3992 pid: 15226 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.524207:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.524208:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.524209:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.524210:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d7980/0xefc4487a0187969b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301856 expref: 3992 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524210:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.524212:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301833 expref: 5954 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.524214:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d7980/0xefc4487a0187969b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301856 expref: 3992 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524216:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301833 expref: 5954 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.524218:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d7980, rc 0) 00000100:00100000:0.0:1705683932.524227:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:7259:x1788538641062272:12345-192.168.203.41@tcp:101:dd.0 Request processed in 320us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.524228:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d7c00/0xefc4487a01879678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301833 expref: 5954 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.524230:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921071 00000100:00100000:1.0:1705683932.524234:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584530112:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.524250:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.524278:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.524287:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524288:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524291:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062336 00000100:00100000:1.0:1705683932.524295:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.524296:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3992 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.524307:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524307:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524309:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062464 00010000:00010000:0.0:1705683932.524312:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.524317:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524318:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524319:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333112 00000100:00100000:0.0:1705683932.524321:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:1855:x1788538641062336:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.524324:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.524328:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3992 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.524332:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3992 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.524334:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524335:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.524338:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0baa80/0xefc4487a01863679 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9527:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2a5 expref: 3992 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.524341:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333113 00010000:00010000:0.0:1705683932.524342:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.524343:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.524344:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30182c expref: 3991 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.524344:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1855:x1788538641062464:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.524351:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30182c expref: 3991 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524352:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.524359:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f1c3c00/0xefc4487a01879671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9527:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30182c expref: 3991 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524361:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.524363:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584530176:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.524367:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.524375:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.524376:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f5e800/0xefc4487a01847ae0 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd2d expref: 5955 pid: 15123 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.524384:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.524384:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.524386:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301848 expref: 3991 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.524391:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.524392:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301848 expref: 3991 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524406:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d4f00/0xefc4487a01879686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301848 expref: 3991 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.524413:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584530240:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.524425:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.524429:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.524437:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524438:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524442:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062528 00000100:00100000:0.0:1705683932.524451:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.524460:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524461:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524464:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524464:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062592 00000100:00100000:0.0:1705683932.524465:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524467:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062656 00000100:00100000:1.0:1705683932.524479:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524480:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524480:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524481:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.524483:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921072 00000100:00100000:0.0:1705683932.524486:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921073 00000100:00100000:1.0:1705683932.524486:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3490:16415:x1788538641062528:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.524488:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:6521:x1788538641062592:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.524492:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.524492:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.524498:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524499:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524506:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921074 00000100:00100000:3.0:1705683932.524509:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d335a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3565:6496:x1788538641062656:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.524515:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.524652:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30185d expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524663:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3565 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524667:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.524668:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.524669:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30185d expref: 3491 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524679:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3565 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.524683:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3565 pid: 14282 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.524690:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584530304:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.524697:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345cf00/0xefc4487a018796a9 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30186b expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.524703:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181ae40 going to sleep for 11 seconds 00002000:00010000:3.0:1705683932.524718:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.524727:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.524728:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.524731:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345cf00/0xefc4487a018796a9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30186b expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.524739:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345cf00/0xefc4487a018796a9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30186b expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.524746:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345cf00, rc 0) 00000100:00100000:3.0:1705683932.524765:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d335a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:6496:x1788538641062656:12345-192.168.203.41@tcp:101:dd.0 Request processed in 255us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.524770:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921074 00010000:00010000:0.0:1705683932.524801:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d4780/0xefc4487a018796b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.524809:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.524821:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584530112:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.524832:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.524843:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:1854:x1788538641062400:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 666us (704us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.524846:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.524847:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.524848:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333111 00010000:00010000:0.0:1705683932.524849:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d4780/0xefc4487a018796b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301864 expref: 5956 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.524854:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d4780/0xefc4487a018796b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301864 expref: 5956 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.524858:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d4780, rc 0) 00000100:00100000:0.0:1705683932.524904:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584530176:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.524910:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.524918:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:1855:x1788538641062336:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 596us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.524921:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333112 00000100:00100000:1.0:1705683932.524921:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.524932:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5956:6521:x1788538641062592:12345-192.168.203.41@tcp:101:dd.0 Request processed in 444us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.524934:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921073 00000100:00100000:0.0:1705683932.524939:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524939:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524941:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062720 00000100:00100000:0.0:1705683932.524948:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524948:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524949:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524949:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.524951:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921075 00000100:00100000:0.0:1705683932.524953:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3566:7259:x1788538641062720:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.524956:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.524978:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.524989:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524989:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.524992:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062784 00000100:00100000:3.0:1705683932.525002:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.525002:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.525005:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921076 00000100:00100000:3.0:1705683932.525007:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3492:16443:x1788538641062784:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.525011:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.525029:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391d6580/0xefc4487a018796b7 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301872 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.525035:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.525041:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.525042:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.525044:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d6580/0xefc4487a018796b7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301872 expref: 3567 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.525048:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391d6580/0xefc4487a018796b7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301872 expref: 3567 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.525052:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d6580, rc 0) 00000100:00100000:0.0:1705683932.525062:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:7259:x1788538641062720:12345-192.168.203.41@tcp:101:dd.0 Request processed in 109us (143us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.525064:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301879 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.525065:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921075 00010000:00010000:3.0:1705683932.525086:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3566 pid: 8804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525090:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.525091:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.525092:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301879 expref: 3493 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525101:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3566 pid: 8804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525105:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3566 pid: 8804 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.525111:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584530368:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.525128:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.525500:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.525516:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.525524:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525524:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525527:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062848 00000100:00100000:1.0:1705683932.525527:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584530240:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.525534:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525535:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525536:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062912 00010000:00010000:1.0:1705683932.525536:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.525540:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525540:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525542:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921077 00000100:00100000:0.0:1705683932.525544:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:6554:x1788538641062848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.525548:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.525549:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:1855:x1788538641062464:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1205us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.525554:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333113 00000100:00100000:3.0:1705683932.525559:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.525560:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525565:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525566:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.525567:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921078 00000100:00100000:3.0:1705683932.525571:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d336e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:4708:x1788538641062912:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.525573:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301880 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525578:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.525581:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3569 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.525587:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.525588:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.525589:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301880 expref: 3569 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.525596:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3569 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.525600:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3569 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.525639:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301887 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525654:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.525659:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.525660:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.525662:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301887 expref: 3570 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.525668:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584530432:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.525675:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.525678:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.525682:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.525686:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.525688:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525688:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525691:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641062976 00000100:00100000:3.0:1705683932.525693:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584530496:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.525723:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.525725:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525730:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.525732:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921079 00000100:00100000:3.0:1705683932.525736:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3494:6521:x1788538641062976:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.525740:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525741:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.525742:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.525745:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063040 00000100:00100000:1.0:1705683932.525756:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525757:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.525762:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921080 00000100:00100000:1.0:1705683932.525765:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3990:6496:x1788538641063040:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.525770:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.525792:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.525797:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525797:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525799:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063104 00000100:00100000:0.0:1705683932.525806:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525807:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.525809:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921081 00000100:00100000:0.0:1705683932.525810:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3991:7259:x1788538641063104:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.525814:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.525932:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c895680/0xefc4487a018796d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301895 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525937:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345d680/0xefc4487a018796da lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30188e expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.525943:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1705683932.525949:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.525951:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.525952:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.525954:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c895680/0xefc4487a018796d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301895 expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525957:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.525959:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.525961:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345d680/0xefc4487a018796da lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30188e expref: 3495 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.525962:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c895680/0xefc4487a018796d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301895 expref: 3992 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.525968:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c895680, rc 0) 00010000:00010000:3.0:1705683932.525969:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345d680/0xefc4487a018796da lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30188e expref: 3495 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.525975:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345d680, rc 0) 00000100:00100000:1.0:1705683932.525984:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:6496:x1788538641063040:12345-192.168.203.41@tcp:101:dd.0 Request processed in 219us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.525989:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921080 00000100:00100000:3.0:1705683932.525991:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3495:6521:x1788538641062976:12345-192.168.203.41@tcp:101:dd.0 Request processed in 255us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.525994:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921079 00000100:00100000:3.0:1705683932.526022:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.526058:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584530368:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.526079:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301879 expref: 3494 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.526085:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345e300, rc 0) 00000100:00100000:1.0:1705683932.526094:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.526095:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3494:16443:x1788538641062784:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1087us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.526098:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921076 00000100:00100000:1.0:1705683932.526104:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.526105:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.526109:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063232 00010000:00010000:1.0:1705683932.526119:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3571 pid: 8804 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.526137:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.526137:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.526140:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333114 00000100:00100000:1.0:1705683932.526143:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1857:x1788538641063232:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.526148:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.526151:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3571 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.526156:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3571 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.526168:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ebc280/0xefc4487a017f9267 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc440 expref: 3571 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.526177:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.526178:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.526180:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301879 expref: 3493 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.526185:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301879 expref: 3493 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526198:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d5180/0xefc4487a018796e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9656:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30189c expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.526200:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007345e300/0xefc4487a018796be lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301879 expref: 3493 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.526207:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9656:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.526207:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584530560:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.526212:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526213:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526215:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d5180/0xefc4487a018796e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30189c expref: 3992 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526219:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d5180/0xefc4487a018796e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30189c expref: 3992 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526223:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d5180, rc 0) 00000100:00100000:1.0:1705683932.526223:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.526233:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:7259:x1788538641063104:12345-192.168.203.41@tcp:101:dd.0 Request processed in 422us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.526236:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921081 00000100:00100000:1.0:1705683932.526238:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584530304:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.526250:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30185d expref: 3493 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.526253:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.526257:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c897980, rc 0) 00000100:00100000:0.0:1705683932.526258:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526258:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526261:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063168 00010000:00010000:0.0:1705683932.526266:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3571 pid: 14282 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.526269:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3493:16415:x1788538641062528:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1782us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.526272:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526272:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.526273:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921072 00000100:00100000:0.0:1705683932.526274:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333115 00000100:00100000:0.0:1705683932.526275:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1857:x1788538641063168:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.526278:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.526280:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3571 pid: 14282 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.526283:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3571 pid: 14282 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.526290:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013311b980/0xefc4487a01822ca2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da6f5 expref: 3571 pid: 14282 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.526294:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526295:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526296:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30185d expref: 3492 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526299:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30185d expref: 3492 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526307:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c897980/0xefc4487a018796a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30185d expref: 3492 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.526311:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584530624:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.526320:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.526324:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.526340:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584530432:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.526348:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301880 expref: 3570 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526352:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d7480, rc 0) 00000100:00100000:0.0:1705683932.526356:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526357:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526359:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063296 00010000:00010000:0.0:1705683932.526362:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3571 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.526368:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526369:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526370:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333116 00000100:00100000:0.0:1705683932.526372:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1856:x1788538641063296:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.526374:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.526379:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3571 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.526383:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3571 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.526389:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14baa80/0xefc4487a01863680 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ac expref: 3571 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.526393:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526394:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526395:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301880 expref: 3570 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526398:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301880 expref: 3570 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526453:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801391d7480/0xefc4487a018796c5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301880 expref: 3570 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.526458:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584530688:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.526470:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.526479:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:6554:x1788538641062848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 935us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.526482:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921077 00000100:00100000:1.0:1705683932.526501:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.526526:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526526:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526529:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063360 00000100:00100000:0.0:1705683932.526535:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526536:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.526538:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921082 00000100:00100000:0.0:1705683932.526540:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:6496:x1788538641063360:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.526543:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.526695:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391d6800/0xefc4487a018796e8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x839f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018a3 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.526701:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x839f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.526706:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526720:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.526722:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391d6800/0xefc4487a018796e8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018a3 expref: 3571 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526766:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391d6800/0xefc4487a018796e8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x839f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018a3 expref: 3571 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.526770:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d6800, rc 0) 00000100:00100000:0.0:1705683932.526787:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:6496:x1788538641063360:12345-192.168.203.41@tcp:101:dd.0 Request processed in 246us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.526790:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921082 00000100:00100000:0.0:1705683932.527059:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.527084:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527085:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527090:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063424 00000100:00100000:0.0:1705683932.527092:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584530688:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.527092:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584530496:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.527098:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.527102:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.527102:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301887 expref: 3570 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.527103:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527106:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921083 00010000:00010000:3.0:1705683932.527107:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345f480, rc 0) 00000100:00100000:0.0:1705683932.527108:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:1856:x1788538641063296:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 735us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.527109:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5955:6521:x1788538641063424:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.527111:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333116 00010000:00010000:1.0:1705683932.527115:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.527120:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d336e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3569:4708:x1788538641062912:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1549us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.527123:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921078 00000100:00100000:0.0:1705683932.527151:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584530624:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.527157:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.527163:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:1857:x1788538641063168:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 887us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.527166:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333115 00000100:00100000:0.0:1705683932.527183:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.527187:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527187:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527189:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063488 00010000:00010000:0.0:1705683932.527194:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.527200:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527200:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527202:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333117 00000100:00100000:0.0:1705683932.527203:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3493:1857:x1788538641063488:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.527207:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.527211:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.527215:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.527329:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584530560:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.527339:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.527349:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:1857:x1788538641063232:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1205us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.527353:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333114 00010000:00010000:0.0:1705683932.527375:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131faca00/0xefc4487a01847acb lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd34 expref: 3493 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.527380:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.527380:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c897c00/0xefc4487a018796ef lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018aa expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.527381:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.527382:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301887 expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.527385:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301887 expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.527389:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.527394:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007345f480/0xefc4487a018796cc lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301887 expref: 3566 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.527396:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.527397:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.527398:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584530752:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.527399:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c897c00/0xefc4487a018796ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018aa expref: 5956 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.527406:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c897c00/0xefc4487a018796ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018aa expref: 5956 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.527409:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.527411:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c897c00, rc 0) 00000100:00100000:1.0:1705683932.527421:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5956:6521:x1788538641063424:12345-192.168.203.41@tcp:101:dd.0 Request processed in 312us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.527426:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921083 00000100:00100000:0.0:1705683932.527429:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.527434:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527434:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527437:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063552 00000100:00100000:0.0:1705683932.527442:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.527452:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527453:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527455:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063616 00000100:00100000:0.0:1705683932.527456:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527456:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527460:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921084 00000100:00100000:1.0:1705683932.527462:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527463:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.527466:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.527467:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527468:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921085 00000100:00100000:1.0:1705683932.527472:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d331e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5956:16443:x1788538641063616:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.527476:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.527512:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d334600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3992:6554:x1788538641063552:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.527518:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.527533:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018b1 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.527540:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3993 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.527543:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.527544:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.527545:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b1 expref: 3993 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.527552:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3993 pid: 15179 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.527556:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3993 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.527560:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d337300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584530816:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.527570:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.527590:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.527607:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018b8 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.527608:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.527608:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.527610:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.527612:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063680 00010000:00010000:1.0:1705683932.527620:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3993 pid: 15161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.527623:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.527624:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1705683932.527624:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.527625:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1705683932.527625:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063744 00010000:00010000:1.0:1705683932.527627:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b8 expref: 5958 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.527631:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.527632:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.527636:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921086 00010000:00010000:1.0:1705683932.527639:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.527640:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d334b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5958:16415:x1788538641063680:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.527644:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.527645:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.527647:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.527652:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584530880:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.527673:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.527681:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527682:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527686:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063808 00000100:00100000:1.0:1705683932.527697:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527698:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527701:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921087 00000100:00100000:1.0:1705683932.527704:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d331900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:6496:x1788538641063744:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.527724:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.527833:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c897480/0xefc4487a01879704 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018c6 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.527841:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.527848:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.527848:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.527851:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c897480/0xefc4487a01879704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018c6 expref: 3995 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.527857:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c897480/0xefc4487a01879704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018c6 expref: 3995 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.527862:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c897480, rc 0) 00000100:00100000:1.0:1705683932.527875:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d331900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:6496:x1788538641063744:12345-192.168.203.41@tcp:101:dd.0 Request processed in 171us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.527879:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921087 00000100:00100000:1.0:1705683932.527888:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527889:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.527892:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921088 00010000:00010000:3.0:1705683932.527893:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018bf expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.527894:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3567:7259:x1788538641063808:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.527899:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.527904:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3994 pid: 15168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.527908:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.527909:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.527910:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018bf expref: 5959 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.527918:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3994 pid: 15168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.527923:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3994 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.527928:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584530944:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.527945:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.528026:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d330a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584530752:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.528032:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.528040:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3492:1857:x1788538641063488:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 836us (857us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.528074:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c894500/0xefc4487a01879712 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018cd expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.528100:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.528107:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528108:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.528110:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333117 00010000:00010000:1.0:1705683932.528111:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c894500/0xefc4487a01879712 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018cd expref: 3568 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528117:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c894500/0xefc4487a01879712 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018cd expref: 3568 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528122:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c894500, rc 0) 00000100:00100000:1.0:1705683932.528136:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:7259:x1788538641063808:12345-192.168.203.41@tcp:101:dd.0 Request processed in 241us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.528137:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d337300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584530816:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.528141:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921088 00010000:00010000:0.0:1705683932.528145:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b1 expref: 3994 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.528150:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391d6f80, rc 0) 00000100:00100000:0.0:1705683932.528158:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d334600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:6554:x1788538641063552:12345-192.168.203.41@tcp:101:dd.0 Request processed in 696us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.528161:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921084 00000100:00100000:0.0:1705683932.528227:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.528243:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528244:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528248:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063872 00000100:00100000:1.0:1705683932.528260:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528261:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528264:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921089 00000100:00100000:1.0:1705683932.528267:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d337300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3492:6521:x1788538641063872:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.528272:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.528331:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.528337:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528337:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528340:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641063936 00010000:00010000:0.0:1705683932.528346:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3994 pid: 15179 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.528353:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528353:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528355:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333118 00000100:00100000:0.0:1705683932.528357:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:1856:x1788538641063936:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.528361:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.528365:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3994 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.528369:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3994 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.528376:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0bb480/0xefc4487a0186368e lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9528:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2b3 expref: 3994 pid: 15179 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.528380:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.528381:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.528382:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b1 expref: 3993 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.528385:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b1 expref: 3993 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.528393:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d6f80/0xefc4487a018796f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9528:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b1 expref: 3993 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.528396:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d335000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584531008:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.528406:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.528418:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.528423:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528424:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528426:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064000 00010000:00010000:0.0:1705683932.528430:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.528442:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528442:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528457:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528458:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528484:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333119 00000100:00100000:0.0:1705683932.528487:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:1856:x1788538641064000:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.528491:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.528492:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.528496:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.528501:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584530880:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.528503:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073754780/0xefc4487a017f939b lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc47f expref: 3994 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.528508:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.528509:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.528510:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b8 expref: 5959 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.528513:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b8 expref: 5959 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528518:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b8 expref: 5959 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.528522:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c896580/0xefc4487a018796fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018b8 expref: 5959 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.528525:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d330000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584531072:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.528525:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c896580, rc 0) 00000100:00100000:0.0:1705683932.528537:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.528537:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d331e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:16443:x1788538641063616:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1065us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.528541:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921085 00010000:00010000:1.0:1705683932.528555:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c895e00/0xefc4487a01879719 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018d4 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.528562:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.528568:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528569:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528571:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c895e00/0xefc4487a01879719 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018d4 expref: 3493 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528576:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c895e00/0xefc4487a01879719 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018d4 expref: 3493 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528581:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c895e00, rc 0) 00000100:00100000:1.0:1705683932.528591:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d337300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3493:6521:x1788538641063872:12345-192.168.203.41@tcp:101:dd.0 Request processed in 323us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.528595:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921089 00000100:00100000:0.0:1705683932.528623:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.528631:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528632:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528636:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064064 00000100:00100000:3.0:1705683932.528640:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584530944:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.528648:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528649:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.528649:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018bf expref: 5958 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.528652:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921090 00010000:00010000:3.0:1705683932.528654:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345de00, rc 0) 00000100:00100000:1.0:1705683932.528655:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d336900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:4708:x1788538641064064:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.528658:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.528660:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.528666:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d334b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5958:16415:x1788538641063680:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1026us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.528670:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921086 00000100:00100000:1.0:1705683932.528690:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528691:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528694:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064128 00010000:00010000:1.0:1705683932.528702:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3995 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.528722:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528723:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528726:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333120 00000100:00100000:1.0:1705683932.528728:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1855:x1788538641064128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.528732:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.528734:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3995 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.528740:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3995 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.528750:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b3f200/0xefc4487a01822f5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da7c0 expref: 3995 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.528758:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528759:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528761:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018bf expref: 5957 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528770:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018bf expref: 5957 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.528780:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.528783:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007345de00/0xefc4487a0187970b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018bf expref: 5957 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.528789:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584531136:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.528802:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.528802:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.528806:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064192 00000100:00100000:1.0:1705683932.528807:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.528816:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018db expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.528816:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.528816:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.528818:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921091 00000100:00100000:3.0:1705683932.528820:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:7259:x1788538641064192:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.528826:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5957 pid: 8804 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.528826:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.528830:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528831:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.528832:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018db expref: 3996 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.528841:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5957 pid: 8804 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.528845:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5957 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.528855:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584531200:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.528866:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.528917:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.528925:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528926:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528929:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064256 00000100:00100000:0.0:1705683932.528938:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528938:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528941:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921092 00000100:00100000:1.0:1705683932.528941:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.528942:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.528943:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3568:6496:x1788538641064256:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.528947:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.529014:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf5de00/0xefc4487a01879727 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018e9 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.529021:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.529026:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.529027:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.529028:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5de00/0xefc4487a01879727 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018e9 expref: 3569 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.529033:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf5de00/0xefc4487a01879727 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018e9 expref: 3569 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.529036:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5de00, rc 0) 00000100:00100000:0.0:1705683932.529048:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3569:6496:x1788538641064256:12345-192.168.203.41@tcp:101:dd.0 Request processed in 105us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.529051:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921092 00010000:00010000:3.0:1705683932.529151:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007345c780/0xefc4487a0187972e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9657:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018e2 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.529160:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9657:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.529167:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.529167:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.529170:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007345c780/0xefc4487a0187972e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018e2 expref: 3997 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529176:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007345c780/0xefc4487a0187972e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018e2 expref: 3997 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529180:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345c780, rc 0) 00000100:00100000:3.0:1705683932.529195:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:7259:x1788538641064192:12345-192.168.203.41@tcp:101:dd.0 Request processed in 374us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.529198:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921091 00000100:00100000:0.0:1705683932.529249:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d335000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584531008:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.529256:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.529265:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1856:x1788538641063936:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 907us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.529270:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333118 00000100:00100000:0.0:1705683932.529342:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d330000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584531072:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.529347:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.529355:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:1856:x1788538641064000:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 868us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.529358:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333119 00000100:00100000:1.0:1705683932.529404:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.529425:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529426:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529430:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064320 00000100:00100000:0.0:1705683932.529437:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584531136:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.529438:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529439:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529441:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921093 00000100:00100000:3.0:1705683932.529443:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3569:6554:x1788538641064320:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.529444:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.529447:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.529454:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584531200:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.529456:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:1855:x1788538641064128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 727us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.529458:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333120 00010000:00010000:1.0:1705683932.529465:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018db expref: 3993 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529469:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018f0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.529472:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c896f80, rc 0) 00010000:00010000:3.0:1705683932.529478:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3570 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.529481:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.529482:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.529483:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d336900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3993:4708:x1788538641064064:12345-192.168.203.41@tcp:101:dd.0 Request processed in 827us (860us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.529483:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f0 expref: 3570 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.529487:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921090 00010000:00010000:3.0:1705683932.529491:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3570 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.529496:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3570 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.529500:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584531264:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.529516:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.529656:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.529663:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529664:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.529664:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529669:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064384 00000100:00100000:0.0:1705683932.529671:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.529676:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.529677:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529679:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.529682:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064448 00000100:00100000:3.0:1705683932.529682:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529683:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529683:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529683:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529686:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064512 00000100:00100000:0.0:1705683932.529687:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064576 00010000:00010000:0.0:1705683932.529693:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5959 pid: 8804 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.529696:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.529697:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529699:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.529700:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.529701:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921094 00000100:00100000:1.0:1705683932.529705:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:6521:x1788538641064384:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.529705:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921095 00000100:00100000:3.0:1705683932.529718:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3494:16415:x1788538641064448:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.529723:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.529725:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.529749:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529750:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529753:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333121 00000100:00100000:0.0:1705683932.529755:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:1856:x1788538641064576:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.529759:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.529764:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5959 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.529769:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5959 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.529776:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eaf7c00/0xefc4487a01847ad9 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd3b expref: 5959 pid: 8804 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.529816:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.529817:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.529819:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018db expref: 3992 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.529823:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018db expref: 3992 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.529832:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c896f80/0xefc4487a01879720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018db expref: 3992 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.529836:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d335000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584531328:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.529849:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.529855:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529856:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.529859:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921096 00000100:00100000:0.0:1705683932.529861:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3494:16443:x1788538641064512:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.529866:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.529890:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018fe expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529901:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3570 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529904:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.529905:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.529906:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018fe expref: 3495 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.529914:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c894280/0xefc4487a01879743 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3018f7 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529917:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3570 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.529921:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3570 pid: 15148 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1705683932.529922:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.529926:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584531392:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.529930:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.529931:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.529934:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c894280/0xefc4487a01879743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f7 expref: 5959 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.529937:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.529940:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c894280/0xefc4487a01879743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f7 expref: 5959 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.529946:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c894280, rc 0) 00000100:00100000:1.0:1705683932.529961:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:6521:x1788538641064384:12345-192.168.203.41@tcp:101:dd.0 Request processed in 256us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.529965:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921094 00000100:00100000:1.0:1705683932.529999:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.530023:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.530030:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530030:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530034:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064640 00000100:00100000:1.0:1705683932.530042:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530043:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530044:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064704 00000100:00100000:1.0:1705683932.530051:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530051:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.530054:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301905 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.530054:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921097 00000100:00100000:3.0:1705683932.530055:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.530056:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530057:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3993:6496:x1788538641064640:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.530061:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.530064:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.530064:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921098 00010000:00010000:0.0:1705683932.530067:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1705683932.530067:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:7259:x1788538641064704:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.530068:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.530069:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301905 expref: 3496 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.530072:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.530091:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.530095:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.530100:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c822800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584531456:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.530111:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.530165:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.530170:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.530171:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.530174:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064768 00010000:00010000:0.0:1705683932.530179:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3572 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.530184:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c895900/0xefc4487a01879751 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x921f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30190c expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.530186:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.530186:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.530188:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333122 00000100:00100000:0.0:1705683932.530190:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c826e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:1857:x1788538641064768:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.530193:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1705683932.530194:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x921f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.530197:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3572 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.530201:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3572 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.530201:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.530202:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.530204:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c895900/0xefc4487a01879751 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30190c expref: 3994 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.530208:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.530209:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.530210:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f0 expref: 3572 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.530211:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c895900/0xefc4487a01879751 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x921f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30190c expref: 3994 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.530213:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f0 expref: 3572 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.530216:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c895900, rc 0) 00010000:00010000:0.0:1705683932.530221:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f0 expref: 3572 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.530225:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c823700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584531520:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.530230:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3994:6496:x1788538641064640:12345-192.168.203.41@tcp:101:dd.0 Request processed in 173us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.530234:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921097 00000100:00100000:0.0:1705683932.530236:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88008181ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.530323:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095108f00/0xefc4487a01863687 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2ba expref: 3572 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.530331:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584531264:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.530338:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345c000/0xefc4487a01879735 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018f0 expref: 3571 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.530343:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345c000, rc 0) 00000100:00100000:3.0:1705683932.530362:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:6554:x1788538641064320:12345-192.168.203.41@tcp:101:dd.0 Request processed in 918us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.530365:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921093 00010000:00010000:3.0:1705683932.530378:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007345f700/0xefc4487a01879758 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301913 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.530386:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.530392:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.530392:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.530394:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345f700/0xefc4487a01879758 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301913 expref: 3571 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.530399:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345f700/0xefc4487a01879758 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301913 expref: 3571 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.530403:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345f700, rc 0) 00000100:00100000:3.0:1705683932.530413:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:7259:x1788538641064704:12345-192.168.203.41@tcp:101:dd.0 Request processed in 347us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.530415:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921098 00000100:00100000:0.0:1705683932.530785:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.530804:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d335000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584531328:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.530805:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.530806:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.530809:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c823700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584531520:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.530810:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064832 00010000:00010000:0.0:1705683932.530812:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.530820:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.530821:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5958:1856:x1788538641064576:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1065us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.530821:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.530822:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.530824:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921099 00000100:00100000:0.0:1705683932.530826:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333121 00000100:00100000:3.0:1705683932.530827:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3497:6521:x1788538641064832:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.530831:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c826e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:1857:x1788538641064768:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 640us (666us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.530831:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.530835:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333122 00000100:00100000:1.0:1705683932.530876:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c822800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584531456:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.530887:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301905 expref: 3497 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.530893:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5d680, rc 0) 00000100:00100000:1.0:1705683932.530906:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3497:16443:x1788538641064512:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1044us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.530911:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921096 00010000:00010000:3.0:1705683932.530993:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7700/0xefc4487a0187975f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30191a expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.531001:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.531008:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531009:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531010:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7700/0xefc4487a0187975f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30191a expref: 3497 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.531013:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.531015:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7700/0xefc4487a0187975f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30191a expref: 3497 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531019:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb7700, rc 0) 00000100:00100000:0.0:1705683932.531021:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.531024:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531025:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531025:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531025:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531028:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064896 00000100:00100000:1.0:1705683932.531029:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641064960 00000100:00100000:3.0:1705683932.531034:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3497:6521:x1788538641064832:12345-192.168.203.41@tcp:101:dd.0 Request processed in 206us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.531036:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3571 pid: 15148 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.531037:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.531037:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921099 00000100:00100000:0.0:1705683932.531043:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531044:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531046:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333123 00000100:00100000:1.0:1705683932.531047:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531048:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c824b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1856:x1788538641064896:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.531048:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.531051:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.531051:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333124 00010000:00010000:0.0:1705683932.531052:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3571 pid: 15148 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.531053:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c821400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1856:x1788538641064960:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.531053:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584531392:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.531056:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3571 pid: 15148 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.531058:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.531060:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.531064:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084913c00/0xefc4487a0182316b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da861 expref: 3571 pid: 15148 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.531065:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3571 pid: 15224 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.531068:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018fe expref: 3496 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531073:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531073:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531075:0:15215:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018fe expref: 3496 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531090:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013600db80/0xefc4487a017f9569 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc4d3 expref: 3570 pid: 15224 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.531092:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018fe expref: 3496 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531096:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531097:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531100:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301905 expref: 3496 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531105:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301905 expref: 3496 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531108:0:15215:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007345c500/0xefc4487a0187973c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3018fe expref: 3496 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.531114:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584531584:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.531118:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.531120:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d680/0xefc4487a0187974a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6681:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301905 expref: 3496 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.531125:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.531129:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c824b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3569:1856:x1788538641064896:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 80us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.531131:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584531648:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.531132:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333123 00000100:00100000:1.0:1705683932.531146:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.531150:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.531162:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531163:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531167:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065024 00000100:00100000:0.0:1705683932.531168:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.531183:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531184:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531185:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065088 00000100:00100000:1.0:1705683932.531187:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531187:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.531188:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.531192:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531193:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531198:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065152 00000100:00100000:3.0:1705683932.531203:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531204:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531204:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531205:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531206:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921100 00000100:00100000:3.0:1705683932.531208:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c825f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:4708:x1788538641065024:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.531211:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921101 00010000:00010000:3.0:1705683932.531212:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.531214:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c825000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:6496:x1788538641065088:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.531221:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.531224:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.531250:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301921 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531258:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.531262:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531262:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531263:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301921 expref: 3571 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531272:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.531275:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.531280:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584531712:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.531295:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.531301:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531302:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531306:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065216 00000100:00100000:3.0:1705683932.531312:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531313:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531315:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921102 00000100:00100000:3.0:1705683932.531317:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c820a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:7259:x1788538641065152:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.531320:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.531325:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c895b80/0xefc4487a0187976d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301928 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.531333:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.531340:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531341:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531343:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c895b80/0xefc4487a0187976d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301928 expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531349:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c895b80/0xefc4487a0187976d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301928 expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531354:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c895b80, rc 0) 00000100:00100000:1.0:1705683932.531368:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c825000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:6496:x1788538641065088:12345-192.168.203.41@tcp:101:dd.0 Request processed in 154us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.531372:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921101 00000100:00100000:1.0:1705683932.531379:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531380:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.531383:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921103 00000100:00100000:1.0:1705683932.531386:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c823200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3995:6554:x1788538641065216:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.531391:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.531406:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301936 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531414:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.531418:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531419:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.531420:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301936 expref: 3996 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.531433:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.531440:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.531446:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584531776:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.531470:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.531625:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4000/0xefc4487a0187977b lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9658:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30192f expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.531632:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9658:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.531637:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531638:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.531640:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4000/0xefc4487a0187977b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30192f expref: 3997 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531645:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4000/0xefc4487a0187977b lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30192f expref: 3997 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.531648:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb4000, rc 0) 00000100:00100000:3.0:1705683932.531667:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c820a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:7259:x1788538641065152:12345-192.168.203.41@tcp:101:dd.0 Request processed in 349us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.531670:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921102 00000100:00100000:3.0:1705683932.531761:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584531584:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.531767:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007345c500, rc 0) 00000100:00100000:0.0:1705683932.531768:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.531780:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3496:16415:x1788538641064448:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 2062us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.531783:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921095 00000100:00100000:1.0:1705683932.531792:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584531648:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.531804:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.531818:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c821400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:1856:x1788538641064960:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 764us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.531825:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333124 00000100:00100000:3.0:1705683932.531930:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531931:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531933:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065280 00000100:00100000:3.0:1705683932.531940:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531940:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.531942:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921104 00000100:00100000:3.0:1705683932.531944:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c824100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5958:6521:x1788538641065280:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.531948:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.531958:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cda00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584531776:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.531967:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301936 expref: 3996 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.531973:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c896300, rc 0) 00000100:00100000:0.0:1705683932.531984:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c823200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:6554:x1788538641065216:12345-192.168.203.41@tcp:101:dd.0 Request processed in 598us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.531987:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921103 00010000:00010000:3.0:1705683932.532231:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6300/0xefc4487a01879782 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30193d expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.532239:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.532244:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.532245:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.532247:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6300/0xefc4487a01879782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30193d expref: 5959 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.532251:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6300/0xefc4487a01879782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30193d expref: 5959 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.532255:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb6300, rc 0) 00000100:00100000:3.0:1705683932.532275:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c824100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:6521:x1788538641065280:12345-192.168.203.41@tcp:101:dd.0 Request processed in 330us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.532280:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921104 00000100:00100000:0.0:1705683932.532287:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.532297:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584531712:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.532303:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301921 expref: 3570 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.532308:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb6f80, rc 0) 00000100:00100000:3.0:1705683932.532317:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c825f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:4708:x1788538641065024:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1108us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.532320:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921100 00000100:00100000:3.0:1705683932.532323:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532323:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532325:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065408 00000100:00100000:3.0:1705683932.532333:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532333:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532335:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921105 00000100:00100000:3.0:1705683932.532336:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c826400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5959:16443:x1788538641065408:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.532339:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.532351:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.532360:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532361:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532364:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065472 00000100:00100000:1.0:1705683932.532367:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.532372:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.532374:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532375:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532378:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532379:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532379:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065536 00010000:00010000:1.0:1705683932.532387:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.532395:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301944 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.532399:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532400:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532402:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333125 00010000:00010000:3.0:1705683932.532403:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.532406:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3496:1857:x1788538641065472:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.532407:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.532408:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.532409:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301944 expref: 5960 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.532411:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.532417:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333126 00010000:00010000:1.0:1705683932.532418:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.532420:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1854:x1788538641065536:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.532420:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.532424:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.532424:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.532425:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.532429:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.532429:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584531840:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.532434:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c19b80/0xefc4487a01847aee lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd42 expref: 3496 pid: 15115 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.532436:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.532444:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca7f200/0xefc4487a01863695 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9529:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c1 expref: 3996 pid: 15145 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.532444:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.532444:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.532445:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.532447:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301921 expref: 3569 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.532450:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.532450:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.532452:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301936 expref: 3995 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.532455:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301936 expref: 3995 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.532455:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301921 expref: 3569 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.532465:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c896300/0xefc4487a01879774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9529:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301936 expref: 3995 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.532469:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c821e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584531904:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.532470:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb6f80/0xefc4487a01879766 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301921 expref: 3569 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.532476:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cb700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584531968:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.532481:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.532492:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.532516:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.532525:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532526:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532532:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065344 00000100:00100000:3.0:1705683932.532546:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532546:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532549:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413480 00000100:00100000:3.0:1705683932.532550:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1814:7304:x1788538641065344:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:3.0:1705683932.532558:0:8825:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.532567:0:8825:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4f00/0xefc4487a01879790 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30194b expref: -99 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.532578:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.532599:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.532623:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.532631:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.532636:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.532640:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.532740:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.532743:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.532746:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.532776:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.532788:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532789:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532793:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065600 00000100:00100000:1.0:1705683932.532807:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532808:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532809:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065664 00010000:00010000:3.0:1705683932.532809:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00000100:00100000:0.0:1705683932.532811:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532811:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.532814:0:8825:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1939 pid: 14202 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.532815:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065728 00000100:00100000:1.0:1705683932.532816:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532817:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.532817:0:8825:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.532819:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065792 00000100:00100000:0.0:1705683932.532824:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532824:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532825:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.532826:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.532827:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921106 00010000:00010000:3.0:1705683932.532828:0:8825:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1939 pid: 14202 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.532829:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:6496:x1788538641065600:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.532830:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921107 00010000:00010000:3.0:1705683932.532832:0:8825:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1939 pid: 14202 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.532833:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3570:7259:x1788538641065664:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.532834:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.532837:0:8825:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8825:1788538584532032:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.532838:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.532853:0:8825:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.532863:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532864:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.532868:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921108 00000100:00100000:3.0:1705683932.532870:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:16415:x1788538641065728:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.532876:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.533008:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c894780/0xefc4487a018797ac lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301959 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.533022:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.533030:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533031:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533033:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c894780/0xefc4487a018797ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301959 expref: 3571 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533040:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c894780/0xefc4487a018797ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301959 expref: 3571 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533046:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c894780, rc 0) 00000100:00100000:1.0:1705683932.533062:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:7259:x1788538641065664:12345-192.168.203.41@tcp:101:dd.0 Request processed in 227us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.533066:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921107 00010000:00010000:3.0:1705683932.533067:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301960 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533068:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ca00/0xefc4487a018797ba lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301952 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.533076:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.533090:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533091:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.533092:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.533093:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.533094:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301960 expref: 5962 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.533095:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921109 00000100:00100000:1.0:1705683932.533098:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3496:6521:x1788538641065792:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.533103:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533104:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.533107:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.533111:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584532096:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.533124:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00002000:00010000:0.0:1705683932.533125:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9220:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.533132:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.533133:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.533136:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ca00/0xefc4487a018797ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301952 expref: 3997 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533140:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ca00/0xefc4487a018797ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301952 expref: 3997 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533144:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5ca00, rc 0) 00000100:00100000:0.0:1705683932.533155:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:6496:x1788538641065600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 326us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.533158:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921106 00000100:00100000:3.0:1705683932.533187:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584531840:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.533194:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301944 expref: 5962 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.533198:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb6080, rc 0) 00000100:00100000:0.0:1705683932.533199:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c821e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584531904:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.533207:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c826400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:16443:x1788538641065408:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 870us (921us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.533208:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.533211:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921105 00000100:00100000:0.0:1705683932.533217:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1854:x1788538641065536:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 797us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.533220:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333126 00010000:00010000:1.0:1705683932.533226:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf6aa80/0xefc4487a018797c1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301967 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.533234:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.533254:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.533254:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cb700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584531968:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.533257:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.533258:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.533260:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065856 00010000:00010000:1.0:1705683932.533262:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.533273:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3497:1857:x1788538641065472:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 867us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.533278:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333125 00010000:00010000:1.0:1705683932.533294:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533295:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533298:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6aa80/0xefc4487a018797c1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301967 expref: 3496 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533304:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.533305:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf6aa80/0xefc4487a018797c1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301967 expref: 3496 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533311:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf6aa80, rc 0) 00000100:00100000:0.0:1705683932.533313:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.533313:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.533315:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333127 00000100:00100000:0.0:1705683932.533317:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c821e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1854:x1788538641065856:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.533320:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.533321:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.533322:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3496:6521:x1788538641065792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 224us (547us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.533325:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.533327:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921109 00010000:00010000:0.0:1705683932.533332:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a695b80/0xefc4487a017f9673 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc527 expref: 3996 pid: 15222 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.533337:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.533337:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.533338:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301944 expref: 5961 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533342:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301944 expref: 5961 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.533350:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6080/0xefc4487a01879789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301944 expref: 5961 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.533353:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.533356:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c820500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532160:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.533368:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.533397:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.533405:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533406:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533410:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065920 00000100:00100000:1.0:1705683932.533419:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533420:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533422:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641065984 00000100:00100000:1.0:1705683932.533434:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533435:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.533436:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.533437:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.533439:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921110 00000100:00100000:1.0:1705683932.533442:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3571:6554:x1788538641065920:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.533442:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921111 00000100:00100000:3.0:1705683932.533444:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:4708:x1788538641065984:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.533447:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.533449:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.533469:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30196e expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533483:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.533488:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533489:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.533490:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30196e expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.533502:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.533508:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.533509:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301975 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.533515:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584532224:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.533517:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.533521:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.533521:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.533522:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301975 expref: 3997 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.533530:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.533533:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff880132182c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.533534:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.533538:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584532288:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.533549:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.533945:0:8825:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8825:1788538584532032:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.533952:0:8825:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00100000:3.0:1705683932.533956:0:8825:0:(ldlm_request.c:181:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.533957:0:8825:0:(ldlm_request.c:189:ldlm_cp_timeout()) NULL obd 00010000:00100000:3.0:1705683932.533958:0:8825:0:(ldlm_request.c:190:ldlm_cp_timeout()) NULL obd 00000100:00100000:3.0:1705683932.534035:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584532096:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.534043:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301960 expref: 5961 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.534048:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb6800, rc 0) 00000100:00100000:0.0:1705683932.534051:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c820500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532160:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.534059:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.534062:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:16415:x1788538641065728:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1191us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.534065:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921108 00000100:00100000:0.0:1705683932.534082:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c821e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:1854:x1788538641065856:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 764us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.534082:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584532224:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.534085:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333127 00010000:00010000:1.0:1705683932.534092:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30196e expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.534099:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf6ad00, rc 0) 00000100:00100000:1.0:1705683932.534111:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:6554:x1788538641065920:12345-192.168.203.41@tcp:101:dd.0 Request processed in 669us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.534115:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921110 00000100:00100000:0.0:1705683932.534168:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584532288:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.534177:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301975 expref: 3996 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.534180:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.534182:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb5400, rc 0) 00000100:00100000:1.0:1705683932.534192:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534193:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534194:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:4708:x1788538641065984:12345-192.168.203.41@tcp:101:dd.0 Request processed in 749us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.534197:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921111 00000100:00100000:1.0:1705683932.534199:0:14260:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066112 00000100:00100000:1.0:1705683932.534221:0:14260:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534221:0:14260:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534225:0:14260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107580 00000100:00100000:1.0:1705683932.534229:0:14260:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1940:12514:x1788538641066112:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1705683932.534306:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.534310:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534311:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534313:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066368 00000100:00100000:0.0:1705683932.534320:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534321:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534322:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921112 00000100:00100000:0.0:1705683932.534324:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c820500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3496:16443:x1788538641066368:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.534328:0:14260:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_008:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1941:12514:x1788538641066112:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 98us (147us total) trans 4295085015 rc 0/0 00000100:00100000:1.0:1705683932.534332:0:14260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107580 00000100:00100000:3.0:1705683932.534343:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.534358:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534359:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.534361:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.534362:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066240 00010000:00010000:1.0:1705683932.534369:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.534378:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534378:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534381:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333128 00000100:00100000:1.0:1705683932.534383:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:1856:x1788538641066240:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.534387:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.534392:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.534398:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.534406:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f20780/0xefc4487a01847af5 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd49 expref: 5961 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.534417:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.534418:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.534420:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30197c expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.534420:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301975 expref: 3995 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.534422:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.534425:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301975 expref: 3995 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.534434:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534434:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.534436:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb5400/0xefc4487a018797cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301975 expref: 3995 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.534436:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.534438:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066176 00000100:00100000:1.0:1705683932.534441:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532352:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.534445:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.534447:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.534453:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534453:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534455:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066304 00010000:00010000:0.0:1705683932.534458:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.534460:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.534463:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.534470:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534470:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534470:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534471:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534472:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333129 00000100:00100000:0.0:1705683932.534474:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1857:x1788538641066176:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.534475:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333130 00000100:00100000:3.0:1705683932.534476:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.534477:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.534477:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.534478:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.534478:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:1857:x1788538641066304:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.534482:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3996 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.534483:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.534483:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.534484:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.534487:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066432 00010000:00010000:0.0:1705683932.534489:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131797980/0xefc4487a0182354d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da95d expref: 3997 pid: 15225 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.534489:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.534495:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3572 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.534495:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.534496:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.534496:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.534497:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.534497:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066496 00010000:00010000:0.0:1705683932.534498:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301960 expref: 5960 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.534502:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301960 expref: 5960 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.534502:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.534502:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.534504:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14b8f00/0xefc4487a0186369c lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2c8 expref: 3573 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.534505:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921113 00000100:00100000:3.0:1705683932.534507:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:7259:x1788538641066432:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.534510:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb6800/0xefc4487a018797b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301960 expref: 5960 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.534512:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.534512:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.534513:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.534514:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c826900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584532416:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.534515:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30196e expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.534519:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30196e expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.534527:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.534530:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf6ad00/0xefc4487a018797c8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30196e expref: 3572 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.534536:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584532480:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.534540:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.534543:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.534543:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.534544:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30197c expref: 3497 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.534548:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.534551:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.534554:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.534557:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.534557:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534559:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584532544:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.534562:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921114 00000100:00100000:0.0:1705683932.534565:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.534566:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907ac600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:6496:x1788538641066496:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.534571:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.534648:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf68f00/0xefc4487a018797dd lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30198a expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.534650:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00002000:00010000:1.0:1705683932.534657:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.534658:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534658:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534661:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066560 00010000:00010000:1.0:1705683932.534665:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.534665:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.534668:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.534668:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf68f00/0xefc4487a018797dd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30198a expref: 3573 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.534669:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534671:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921115 00000100:00100000:0.0:1705683932.534673:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:6521:x1788538641066560:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.534677:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.534677:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf68f00/0xefc4487a018797dd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30198a expref: 3573 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.534682:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf68f00, rc 0) 00000100:00100000:1.0:1705683932.534692:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907ac600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3573:6496:x1788538641066496:12345-192.168.203.41@tcp:101:dd.0 Request processed in 127us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.534696:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921114 00000100:00100000:1.0:1705683932.534757:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.534843:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4500/0xefc4487a018797e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9659:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301983 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.534850:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9659:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.534856:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.534857:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.534860:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4500/0xefc4487a018797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301983 expref: 3997 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.534865:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4500/0xefc4487a018797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301983 expref: 3997 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.534867:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534868:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.534868:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb4500, rc 0) 00000100:00100000:0.0:1705683932.534872:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066624 00000100:00100000:3.0:1705683932.534878:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3997:7259:x1788538641066432:12345-192.168.203.41@tcp:101:dd.0 Request processed in 370us (431us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.534879:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1941 pid: 14202 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.534881:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921113 00000100:00100000:0.0:1705683932.534897:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534897:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.534899:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333131 00000100:00100000:0.0:1705683932.534901:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1941:1856:x1788538641066624:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.534905:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.534907:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1941 pid: 14202 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.534910:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1941 pid: 14202 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.534919:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011f103200/0xefc4487a0186c29c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fdc0b expref: 1941 pid: 14202 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.534925:0:15194:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe8:0x0].0x0 (ffff8800a03d9600) 00010000:00010000:0.0:1705683932.534927:0:15194:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.534931:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.534934:0:15194:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.534944:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.534953:0:8825:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.534955:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+1940:1856:x1788538641066624:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.534957:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333131 00010000:00010000:3.0:1705683932.534957:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:0.0:1705683932.534968:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5fc00/0xefc4487a018797eb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301991 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.534974:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.534979:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.534979:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.534981:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5fc00/0xefc4487a018797eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301991 expref: 5962 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.534985:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5fc00/0xefc4487a018797eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301991 expref: 5962 pid: 15135 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1705683932.534986:0:8825:0:(mdt_handler.c:937:mdt_pack_attr2body()) [0x240000404:0x3fe8:0x0]: returning size 3407872 00000004:00200000:3.0:1705683932.534988:0:8825:0:(mdt_handler.c:1566:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1705683932.534991:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5fc00, rc 0) 00000004:00010000:3.0:1705683932.534998:0:8825:0:(mdt_handler.c:2435:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.535000:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:6521:x1788538641066560:12345-192.168.203.41@tcp:101:dd.0 Request processed in 327us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.535002:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921115 00010000:00010000:3.0:1705683932.535007:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535012:0:8825:0:(ldlm_lock.c:943:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535015:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535018:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535021:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535024:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0fb4780 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.535026:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535029:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535034:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x0 (ffff8800a67af700) 00010000:00010000:3.0:1705683932.535035:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.535036:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535038:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4780/0xefc4487a01879797 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535049:0:8825:0:(ldlm_lock.c:821:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535051:0:8825:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535053:0:8825:0:(ldlm_lockd.c:1943:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535055:0:8825:0:(ldlm_lockd.c:1957:ldlm_handle_bl_callback()) Lock ffff8800a0fb4c80 already unused, calling callback (ffffffffa0d756d0) 00010000:00010000:3.0:1705683932.535056:0:8825:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535058:0:8825:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535060:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe1:0x0].0x39 (ffff8800a6136800) 00010000:00010000:3.0:1705683932.535061:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1705683932.535061:0:8825:0:(ldlm_lockd.c:1967:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535063:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4c80/0xefc4487a0187979e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.535101:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb4f00/0xefc4487a01879790 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30194b expref: 1816 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.535106:0:8825:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30194b expref: 1815 pid: 8825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.535108:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe8:0x0].0x0 (ffff8800a03d9600) 00010000:00010000:3.0:1705683932.535109:0:8825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1705683932.535110:0:8825:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb7480, rc 0) 00000100:00100000:3.0:1705683932.535124:0:8825:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1815:7304:x1788538641065344:12345-192.168.203.41@tcp:101:rm.0 Request processed in 2573us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.535128:0:8825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 413480 00000100:00100000:0.0:1705683932.535595:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c826900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584532416:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.535604:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.535613:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:1857:x1788538641066176:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1138us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.535616:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333129 00000100:00100000:1.0:1705683932.535635:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584532480:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.535645:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.535657:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:1857:x1788538641066304:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1178us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.535669:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333130 00000100:00100000:1.0:1705683932.535699:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532352:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.535721:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.535734:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:1856:x1788538641066240:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1349us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.535738:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333128 00000100:00100000:0.0:1705683932.535799:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584532544:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.535809:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30197c expref: 3497 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.535815:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5db80, rc 0) 00000100:00100000:1.0:1705683932.535823:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.535825:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c820500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3497:16443:x1788538641066368:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1500us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.535827:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921112 00000100:00100000:0.0:1705683932.535832:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.535833:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.535854:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.535860:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.535861:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.535864:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066688 00000100:00100000:0.0:1705683932.535871:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066752 00010000:00010000:1.0:1705683932.535873:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.535880:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.535880:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.535883:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921116 00000100:00100000:0.0:1705683932.535885:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3996:6554:x1788538641066752:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.535888:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.535889:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.535890:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.535892:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333132 00000100:00100000:1.0:1705683932.535895:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:1857:x1788538641066688:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.535900:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.535902:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.535908:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301998 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.535908:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.535915:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3997 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.535918:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.535919:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.535919:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301998 expref: 3997 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.535919:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a612aa80/0xefc4487a017f978b lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc54a expref: 3572 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.535926:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.535926:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.535927:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3997 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.535928:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30197c expref: 3496 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.535930:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3997 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.535933:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30197c expref: 3496 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.535934:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584532608:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.535945:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.535947:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf5db80/0xefc4487a018797d6 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30197c expref: 3496 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.535957:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584532672:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.535960:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.535973:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.535996:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.535997:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536000:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066816 00000100:00100000:0.0:1705683932.536006:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536007:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536009:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921117 00000100:00100000:0.0:1705683932.536010:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c826900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:6496:x1788538641066816:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.536012:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.536014:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.536034:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.536035:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536036:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536041:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066880 00000100:00100000:1.0:1705683932.536047:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.536057:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536057:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536063:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641066944 00000100:00100000:3.0:1705683932.536068:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536069:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536070:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067008 00000100:00100000:3.0:1705683932.536075:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536075:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536081:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536083:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536089:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921118 00000100:00100000:1.0:1705683932.536093:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3498:16415:x1788538641066880:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.536093:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921119 00000100:00100000:3.0:1705683932.536095:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3498:6521:x1788538641066944:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.536101:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536101:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536104:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921120 00010000:00010000:1.0:1705683932.536105:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.536106:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:7259:x1788538641067008:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.536110:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.536178:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019a6 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536184:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c000/0xefc4487a01879800 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9221:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f30199f expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536191:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3572 pid: 15226 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.536192:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9221:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.536195:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.536196:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.536197:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019a6 expref: 3499 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536199:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536208:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3572 pid: 15226 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536214:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3572 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.536220:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584532736:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.536235:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.536255:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.536262:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536263:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536267:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067072 00000100:00100000:1.0:1705683932.536279:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536279:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536282:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921121 00000100:00100000:1.0:1705683932.536285:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3573:4708:x1788538641067072:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.536290:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.536323:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019bb expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536333:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3499 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.536337:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536338:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536339:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019bb expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536349:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3499 pid: 15153 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.536351:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5680/0xefc4487a0187980e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019b4 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536354:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3499 pid: 15153 timeout: 805 lvb_type: 1 00002000:00010000:3.0:1705683932.536358:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.536360:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584532800:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.536365:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.536366:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.536368:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5680/0xefc4487a0187980e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019b4 expref: 3575 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.536371:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.536373:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5680/0xefc4487a0187980e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019b4 expref: 3575 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.536377:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb5680, rc 0) 00000100:00100000:3.0:1705683932.536389:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:7259:x1788538641067008:12345-192.168.203.41@tcp:101:dd.0 Request processed in 282us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.536392:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921120 00010000:00010000:3.0:1705683932.536402:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.536413:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.536416:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c000/0xefc4487a01879800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30199f expref: 3999 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536422:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c000/0xefc4487a01879800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30199f expref: 3999 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.536427:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.536475:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5c000, rc 0) 00000100:00100000:0.0:1705683932.536489:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584532608:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.536496:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301998 expref: 3999 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536500:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5cc80, rc 0) 00000100:00100000:1.0:1705683932.536507:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584532672:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.536509:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:6554:x1788538641066752:12345-192.168.203.41@tcp:101:dd.0 Request processed in 624us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.536512:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921116 00010000:00010000:1.0:1705683932.536516:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.536528:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3574:1857:x1788538641066688:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 632us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.536530:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.536533:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333132 00000100:00100000:1.0:1705683932.536541:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536541:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536544:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067264 00010000:00010000:1.0:1705683932.536551:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3999 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.536555:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.536560:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536560:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536560:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536561:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536563:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067328 00000100:00100000:1.0:1705683932.536563:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333133 00000100:00100000:1.0:1705683932.536566:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c823c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:1857:x1788538641067264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.536570:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536570:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.536570:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.536572:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921122 00000100:00100000:0.0:1705683932.536574:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5961:16443:x1788538641067328:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.536575:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3999 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.536578:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.536580:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3999 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.536591:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5180/0xefc4487a01879815 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019ad expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536592:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b2caa80/0xefc4487a018636a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2cf expref: 3999 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.536597:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536598:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1705683932.536598:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.536600:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301998 expref: 3998 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.536603:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536604:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301998 expref: 3998 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.536604:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.536606:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5180/0xefc4487a01879815 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ad expref: 3500 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.536611:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb5180/0xefc4487a01879815 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ad expref: 3500 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.536614:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5cc80/0xefc4487a018797f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301998 expref: 3998 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.536614:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb5180, rc 0) 00000100:00100000:1.0:1705683932.536619:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532864:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.536623:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3500:6521:x1788538641066944:12345-192.168.203.41@tcp:101:dd.0 Request processed in 528us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.536626:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921119 00000100:00100000:1.0:1705683932.536633:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800834983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.536634:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536635:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536638:0:8825:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067200 00010000:00010000:0.0:1705683932.536640:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019c2 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.536647:0:8825:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.536647:0:8825:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.536649:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.536649:0:8825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 413481 00000100:00100000:3.0:1705683932.536651:0:8825:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+1815:7304:x1788538641067200:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:0.0:1705683932.536652:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.536652:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.536654:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c2 expref: 5962 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536661:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536665:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.536669:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c821900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584532928:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.536670:0:8825:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.536676:0:8825:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7480/0xefc4487a018797a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3fe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f30194b expref: 1815 pid: 8825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.536680:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.536685:0:8825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3fe8:0x0].0x0 (ffff8800a03d9600) 00010000:00010000:3.0:1705683932.536687:0:8825:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.536692:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c826900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:6496:x1788538641066816:12345-192.168.203.41@tcp:101:dd.0 Request processed in 681us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.536695:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921117 00010000:00010000:3.0:1705683932.536702:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb6d00/0xefc4487a01879823 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.536718:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb6d00/0xefc4487a01879823 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.536724:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb6d00/0xefc4487a01879823 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x3fe1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.536814:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7c00/0xefc4487a0187982a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3fe1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.536818:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7c00/0xefc4487a0187982a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.536822:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7c00/0xefc4487a0187982a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3fe1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:0.0:1705683932.536852:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.536864:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536865:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.536868:0:8825:0:(ldlm_lock.c:767:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7980/0xefc4487a01879831 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3fe8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8825 initiator: MDT0 00010000:00010000:3.0:1705683932.536871:0:8825:0:(ldlm_lock.c:1060:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7980/0xefc4487a01879831 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3fe8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8825 initiator: MDT1 00010000:00010000:3.0:1705683932.536874:0:8825:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a0fb7980/0xefc4487a01879831 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3fe8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8825 initiator: MDT1 00000100:00100000:1.0:1705683932.536905:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067392 00010000:00010000:1.0:1705683932.536917:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3574 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.536927:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.536928:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536931:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.536931:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333134 00000100:00100000:1.0:1705683932.536933:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c820f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3574:1855:x1788538641067392:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.536937:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536937:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.536940:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.536941:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067456 00010000:00010000:1.0:1705683932.536943:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3574 pid: 15226 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.536947:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3500 pid: 15153 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.536948:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3574 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.536954:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536955:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.536957:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333135 00010000:00010000:1.0:1705683932.536957:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.536958:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3500:1856:x1788538641067456:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.536958:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536960:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019a6 expref: 3500 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536961:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.536965:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019a6 expref: 3500 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536967:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3500 pid: 15153 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.536970:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3500 pid: 15153 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.536977:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.536978:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.536978:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019a6 expref: 3500 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536979:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019bb expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.536982:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019bb expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.536983:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584532992:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.536991:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019bb expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.536999:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533056:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.536999:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801321bd780 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.537014:0:15095:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007345e580/0xefc4487a01847b11 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd50 expref: 3500 pid: 15153 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.537022:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584532800:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.537031:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf6a580/0xefc4487a01879807 lrc: 5/0,0 mode: PW/PW res: [0x280000403:0x1b28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019bb expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.537040:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf6a580, rc 0) 00000100:00100000:0.0:1705683932.537051:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.537053:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3574:4708:x1788538641067072:12345-192.168.203.41@tcp:101:dd.0 Request processed in 767us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.537056:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921121 00000100:00100000:0.0:1705683932.537073:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.537083:0:14216:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009813ed00/0xefc4487a0182385d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2da9fe expref: 3573 pid: 15226 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.537090:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584532736:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.537099:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf6b200/0xefc4487a018797f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe59f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019a6 expref: 3499 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.537104:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf6b200, rc 0) 00000100:00100000:3.0:1705683932.537109:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.537110:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537113:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3499:16415:x1788538641066880:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1021us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.537115:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067520 00000100:00100000:1.0:1705683932.537116:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921118 00000100:00100000:1.0:1705683932.537124:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537124:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.537126:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.537127:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537128:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921123 00000100:00100000:0.0:1705683932.537129:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537130:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537131:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c827300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:7259:x1788538641067520:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.537136:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.537398:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf69e00/0xefc4487a01879838 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019c9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.537406:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.537413:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.537414:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.537417:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf69e00/0xefc4487a01879838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c9 expref: 3999 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.537422:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf69e00/0xefc4487a01879838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c9 expref: 3999 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.537427:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf69e00, rc 0) 00000100:00100000:1.0:1705683932.537441:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c827300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:7259:x1788538641067520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 310us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.537445:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921123 00000100:00100000:1.0:1705683932.537480:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584532864:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.537487:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.537498:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c823c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:1857:x1788538641067264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 932us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.537502:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333133 00000100:00100000:0.0:1705683932.537506:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c821900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:15147:1788538584532928:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.537513:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c2 expref: 5962 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.537518:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5c780, rc 0) 00000100:00100000:1.0:1705683932.537520:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.537527:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:16443:x1788538641067328:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 952us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.537527:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537528:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537530:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921122 00000100:00100000:1.0:1705683932.537531:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067584 00000100:00100000:1.0:1705683932.537546:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537547:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537547:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537547:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537550:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921124 00000100:00100000:0.0:1705683932.537552:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5962:6521:x1788538641067584:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.537555:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.537787:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5d900/0xefc4487a0187983f lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019d0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.537794:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.537800:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.537801:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.537803:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5d900/0xefc4487a0187983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019d0 expref: 5963 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.537807:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5d900/0xefc4487a0187983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019d0 expref: 5963 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.537811:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5d900, rc 0) 00000100:00100000:0.0:1705683932.537820:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5963:6521:x1788538641067584:12345-192.168.203.41@tcp:101:dd.0 Request processed in 267us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.537822:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921124 00000100:00100000:0.0:1705683932.537838:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.537853:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.537859:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.537875:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533056:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.537881:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.537882:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584532992:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.537888:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3498:1856:x1788538641067456:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 929us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.537890:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333135 00010000:00010000:1.0:1705683932.537891:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.537895:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537895:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537897:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067648 00010000:00010000:0.0:1705683932.537901:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.537904:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c820f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3572:1855:x1788538641067392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 969us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.537907:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537907:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537908:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333134 00000100:00100000:0.0:1705683932.537911:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333136 00000100:00100000:1.0:1705683932.537932:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537933:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.537951:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c821900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:1856:x1788538641067648:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.537956:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.537956:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537956:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.537958:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.537959:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067712 00010000:00010000:0.0:1705683932.537961:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.537969:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537969:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.537970:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801332f8500/0xefc4487a017f98e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5a5 expref: 3998 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.537971:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067776 00010000:00010000:0.0:1705683932.537975:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.537976:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.537977:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c2 expref: 5962 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.537980:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c2 expref: 5962 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.537985:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.537986:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.537988:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c780/0xefc4487a0187981c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019c2 expref: 5962 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.537989:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921125 00000100:00100000:0.0:1705683932.537992:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584533120:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.537992:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c825a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3573:6496:x1788538641067712:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.537997:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.538002:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.538010:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.538010:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538011:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538012:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.538013:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921126 00000100:00100000:0.0:1705683932.538015:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c824600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3573:6554:x1788538641067776:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.538019:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.538034:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019de expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.538041:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3574 pid: 15217 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.538044:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.538044:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.538045:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019de expref: 3574 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.538051:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3574 pid: 15217 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.538055:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3574 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.538059:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584533184:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.538066:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.538094:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.538107:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.538110:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538111:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538115:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067840 00000100:00100000:3.0:1705683932.538128:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538129:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538130:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067904 00000100:00100000:3.0:1705683932.538138:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.538139:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.538142:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.538143:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921127 00000100:00100000:3.0:1705683932.538146:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c820f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5963:16415:x1788538641067840:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.538150:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.538151:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.538152:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.538155:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641067968 00010000:00010000:1.0:1705683932.538158:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1240a00/0xefc4487a0187984d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019d7 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.538165:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.538165:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:1.0:1705683932.538168:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.538169:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921128 00000100:00100000:0.0:1705683932.538172:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c826e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:4708:x1788538641067904:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.538176:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.538176:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.538176:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.538179:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1240a00/0xefc4487a0187984d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019d7 expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.538186:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1240a00/0xefc4487a0187984d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019d7 expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.538192:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1240a00, rc 0) 00010000:00010000:0.0:1705683932.538201:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019ec expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.538205:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c825a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:6496:x1788538641067712:12345-192.168.203.41@tcp:101:dd.0 Request processed in 212us (351us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.538209:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5963 pid: 15169 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.538209:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921125 00010000:00010000:0.0:1705683932.538212:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.538213:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.538214:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ec expref: 3999 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.538218:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.538219:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.538221:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5963 pid: 15169 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.538222:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921129 00000100:00100000:1.0:1705683932.538224:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c824b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:7259:x1788538641067968:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.538225:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5963 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.538229:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88008c821400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584533248:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.538229:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.538237:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.538369:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019e5 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.538382:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.538385:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1242800/0xefc4487a01879862 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019f3 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.538386:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.538386:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.538388:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019e5 expref: 5964 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.538394:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.538401:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.538401:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.538402:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.538405:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242800/0xefc4487a01879862 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019f3 expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.538406:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.538411:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1242800/0xefc4487a01879862 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019f3 expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.538416:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584533312:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.538417:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1242800, rc 0) 00000100:00100000:1.0:1705683932.538433:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c824b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:7259:x1788538641067968:12345-192.168.203.41@tcp:101:dd.0 Request processed in 207us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.538436:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.538437:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921129 00000100:00100000:0.0:1705683932.538835:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.538859:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c821400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584533248:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.538860:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584533120:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.538867:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ec expref: 3999 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.538869:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.538883:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c821900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:1856:x1788538641067648:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 932us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.538887:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333136 00000100:00100000:1.0:1705683932.538896:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.538897:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.538900:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068032 00000100:00100000:1.0:1705683932.538915:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.538916:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.538918:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921130 00010000:00010000:0.0:1705683932.538920:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5ea80, rc 0) 00000100:00100000:1.0:1705683932.538920:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c821e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3498:6521:x1788538641068032:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.538925:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.538930:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c826e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:4708:x1788538641067904:12345-192.168.203.41@tcp:101:dd.0 Request processed in 758us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.538933:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921128 00000100:00100000:0.0:1705683932.538948:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88008c823c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584533184:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.538954:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019de expref: 3575 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.538958:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5e800, rc 0) 00000100:00100000:0.0:1705683932.538964:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c824600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:6554:x1788538641067776:12345-192.168.203.41@tcp:101:dd.0 Request processed in 948us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.538966:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921126 00000100:00100000:0.0:1705683932.538979:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.539008:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.539012:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1242a80/0xefc4487a01879869 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f3019fa expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.539017:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.539017:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.539020:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068160 00002000:00010000:1.0:1705683932.539021:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.539024:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584533312:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.539028:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.539028:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.539029:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.539029:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.539030:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068288 00010000:00010000:1.0:1705683932.539032:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242a80/0xefc4487a01879869 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019fa expref: 3500 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.539034:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.539035:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.539036:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921131 00010000:00010000:3.0:1705683932.539037:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019e5 expref: 5964 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.539038:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:6496:x1788538641068160:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.539038:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1242a80/0xefc4487a01879869 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019fa expref: 3500 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.539042:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.539043:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb4a00, rc 0) 00010000:00010000:1.0:1705683932.539044:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1242a80, rc 0) 00000100:00100000:3.0:1705683932.539056:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c820f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:16415:x1788538641067840:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 909us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.539059:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c821e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3500:6521:x1788538641068032:12345-192.168.203.41@tcp:101:dd.0 Request processed in 137us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.539061:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921127 00000100:00100000:1.0:1705683932.539065:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921130 00000100:00100000:3.0:1705683932.539070:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.539071:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539087:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539088:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.539094:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921132 00000100:00100000:3.0:1705683932.539099:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c821400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3499:16443:x1788538641068288:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.539106:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.539114:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.539121:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539122:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539125:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068096 00010000:00010000:1.0:1705683932.539133:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3575 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.539148:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539149:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.539152:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e080/0xefc4487a01879870 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a01 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.539152:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333137 00000100:00100000:1.0:1705683932.539154:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:1857:x1788538641068096:12345-192.168.203.41@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1705683932.539159:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.539159:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.539165:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.539165:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.539165:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3575 pid: 15217 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.539167:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e080/0xefc4487a01879870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a01 expref: 3999 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.539170:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3575 pid: 15217 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.539171:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5e080/0xefc4487a01879870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a01 expref: 3999 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.539175:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5e080, rc 0) 00010000:00010000:1.0:1705683932.539180:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b0b8f00/0xefc4487a018636aa lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2d6 expref: 3575 pid: 15217 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.539183:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:6496:x1788538641068160:12345-192.168.203.41@tcp:101:dd.0 Request processed in 144us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.539186:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921131 00010000:00010000:1.0:1705683932.539186:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.539187:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.539188:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019de expref: 3574 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.539193:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019de expref: 3574 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.539203:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf5e800/0xefc4487a01879846 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019de expref: 3574 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.539204:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a08 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.539208:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.539212:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533376:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.539214:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.539217:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.539218:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.539219:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a08 expref: 3500 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.539226:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.539229:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.539233:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.539233:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.539234:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539237:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068352 00000100:00100000:3.0:1705683932.539238:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584533440:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.539244:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.539247:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.539254:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539254:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.539255:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.539256:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068224 00010000:00010000:1.0:1705683932.539261:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5964 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.539269:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539270:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539273:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333138 00000100:00100000:3.0:1705683932.539275:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.539276:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c822800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:1857:x1788538641068352:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.539276:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.539281:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.539283:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.539283:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333139 00010000:00010000:1.0:1705683932.539288:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.539288:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c823700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:1857:x1788538641068224:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.539296:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.539297:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b0da080/0xefc4487a01823af6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daac2 expref: 3999 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.539307:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.539308:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.539308:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.539310:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019e5 expref: 5964 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.539315:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019e5 expref: 5964 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.539315:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.539325:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fb4a00/0xefc4487a0187985b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019e5 expref: 5964 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.539330:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584533504:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.539330:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f22080/0xefc4487a01847b34 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd57 expref: 5964 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.539340:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.539341:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.539344:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ec expref: 3998 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.539345:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.539351:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ec expref: 3998 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.539367:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf5ea80/0xefc4487a01879854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f3019ec expref: 3998 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.539373:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584533568:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.539389:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.540044:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.540061:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584533440:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.540063:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584533504:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.540071:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a08 expref: 3500 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.540077:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0fb7200, rc 0) 00010000:00010000:1.0:1705683932.540083:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.540084:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.540088:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540089:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540092:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068416 00000100:00100000:1.0:1705683932.540099:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c822800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:1857:x1788538641068352:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 822us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.540100:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540100:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540102:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068480 00000100:00100000:3.0:1705683932.540103:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584533568:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.540104:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333138 00000100:00100000:0.0:1705683932.540106:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540106:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.540108:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921133 00000100:00100000:0.0:1705683932.540109:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:6521:x1788538641068416:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.540111:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.540121:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c823700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:1857:x1788538641068224:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 834us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.540123:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533376:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.540126:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333139 00010000:00010000:1.0:1705683932.540130:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.540144:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3574:1857:x1788538641068096:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 989us (1030us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.540148:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.540149:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333137 00000100:00100000:3.0:1705683932.540157:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c821400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3500:16443:x1788538641068288:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1058us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.540161:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540162:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.540162:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921132 00000100:00100000:1.0:1705683932.540166:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921134 00000100:00100000:1.0:1705683932.540169:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3998:6554:x1788538641068480:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.540175:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.540296:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c280/0xefc4487a0187987e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a0f expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540296:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a16 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.540303:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.540308:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 3999 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.540309:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.540310:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.540312:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c280/0xefc4487a0187987e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a0f expref: 5964 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540312:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.540313:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.540315:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a16 expref: 3999 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.540316:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf5c280/0xefc4487a0187987e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a0f expref: 5964 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.540320:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5c280, rc 0) 00010000:00010000:1.0:1705683932.540326:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 3999 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.540331:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 3999 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.540337:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584533632:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.540350:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.540366:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:6521:x1788538641068416:12345-192.168.203.41@tcp:101:dd.0 Request processed in 254us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.540369:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921133 00000100:00100000:0.0:1705683932.540388:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.540398:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540398:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540402:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068544 00000100:00100000:1.0:1705683932.540412:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540413:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540415:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921135 00000100:00100000:1.0:1705683932.540418:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3500:16415:x1788538641068544:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.540423:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.540426:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.540452:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.540453:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.540458:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068608 00000100:00100000:3.0:1705683932.540472:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.540473:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.540477:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921136 00000100:00100000:3.0:1705683932.540480:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:7259:x1788538641068608:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.540486:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.540502:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a1d expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540514:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3573 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540519:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.540520:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.540521:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a1d expref: 3501 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540532:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3573 pid: 15214 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540537:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3573 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.540544:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584533696:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.540562:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.540825:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.540850:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099847980/0xefc4487a01879893 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a24 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.540853:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540854:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540858:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068672 00002000:00010000:3.0:1705683932.540859:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.540867:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.540867:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.540868:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.540870:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099847980/0xefc4487a01879893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a24 expref: 4001 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.540875:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099847980/0xefc4487a01879893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a24 expref: 4001 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.540881:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099847980, rc 0) 00000100:00100000:1.0:1705683932.540882:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540883:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.540886:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333140 00000100:00100000:1.0:1705683932.540889:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3574:1857:x1788538641068672:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.540893:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.540895:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.540900:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.540903:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4001:7259:x1788538641068608:12345-192.168.203.41@tcp:101:dd.0 Request processed in 422us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.540906:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921136 00010000:00010000:1.0:1705683932.540913:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c07d680/0xefc4487a017f99f3 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc5dd expref: 3574 pid: 15168 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.540919:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.540920:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.540922:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a08 expref: 3501 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540927:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a08 expref: 3501 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.540941:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0fb7200/0xefc4487a01879877 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6683:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a08 expref: 3501 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.540948:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533760:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.540969:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.540983:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584533632:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.540992:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a16 expref: 4000 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.540993:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.540999:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1240780, rc 0) 00000100:00100000:1.0:1705683932.541012:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:6554:x1788538641068480:12345-192.168.203.41@tcp:101:dd.0 Request processed in 842us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.541015:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.541016:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921134 00000100:00100000:3.0:1705683932.541020:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541021:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541023:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541024:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541026:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068800 00000100:00100000:1.0:1705683932.541027:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068864 00000100:00100000:1.0:1705683932.541038:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541038:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.541038:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3575 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.541041:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921137 00000100:00100000:1.0:1705683932.541044:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:4708:x1788538641068864:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.541054:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541055:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541057:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333141 00000100:00100000:1.0:1705683932.541058:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541059:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541060:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:1856:x1788538641068800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.541065:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.541066:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.541066:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3575 pid: 15214 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.541083:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3575 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.541093:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.541093:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541093:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541095:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a1d expref: 3501 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541099:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a1d expref: 3501 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.541108:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a2b expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541109:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a1d expref: 3501 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.541113:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584533824:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.541120:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3501 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.541125:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.541126:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.541127:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a2b expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.541129:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.541135:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541136:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541138:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068928 00010000:00010000:1.0:1705683932.541139:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3501 pid: 15100 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.541146:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3502 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.541147:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541148:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541150:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921138 00000100:00100000:3.0:1705683932.541152:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3502:6521:x1788538641068928:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.541153:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584533888:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.541156:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.541170:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.541185:0:15215:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a10c7200/0xefc4487a01823dab lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dab8d expref: 3576 pid: 15214 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.541193:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584533696:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.541202:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1242f80/0xefc4487a0187988c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a1d expref: 3502 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.541208:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1242f80, rc 0) 00000100:00100000:0.0:1705683932.541216:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.541221:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3502:16415:x1788538641068544:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 802us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.541227:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921135 00000100:00100000:1.0:1705683932.541238:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541239:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541243:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068736 00010000:00010000:1.0:1705683932.541250:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 4000 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.541250:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099846f80/0xefc4487a018798a1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a32 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.541256:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.541261:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541261:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:3.0:1705683932.541262:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.541264:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333142 00000100:00100000:1.0:1705683932.541266:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880137669050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:1854:x1788538641068736:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.541271:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.541271:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541272:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541275:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099846f80/0xefc4487a018798a1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a32 expref: 3502 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.541279:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 4000 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.541282:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099846f80/0xefc4487a018798a1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a32 expref: 3502 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.541284:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 4000 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.541288:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099846f80, rc 0) 00010000:00010000:1.0:1705683932.541293:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a14ba800/0xefc4487a018636b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2dd expref: 4000 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.541300:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.541301:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.541302:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a16 expref: 3999 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.541306:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3502:6521:x1788538641068928:12345-192.168.203.41@tcp:101:dd.0 Request processed in 152us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.541307:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a16 expref: 3999 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.541310:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921138 00000100:00100000:3.0:1705683932.541316:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541316:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541319:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641068992 00010000:00010000:1.0:1705683932.541320:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1240780/0xefc4487a01879885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a16 expref: 3999 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.541326:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541326:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541327:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584533952:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.541328:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921139 00000100:00100000:3.0:1705683932.541330:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:6496:x1788538641068992:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.541334:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.541342:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39d80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.541357:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584533760:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.541358:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.541366:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.541378:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:1857:x1788538641068672:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 488us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.541383:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333140 00000100:00100000:0.0:1705683932.541389:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.541390:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.541393:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069056 00000100:00100000:1.0:1705683932.541399:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.541400:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.541400:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.541401:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.541403:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921140 00000100:00100000:0.0:1705683932.541405:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:7259:x1788538641069056:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.541410:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.541509:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099845900/0xefc4487a018798a8 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a39 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.541516:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.541522:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541523:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.541525:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099845900/0xefc4487a018798a8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a39 expref: 3577 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541530:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099845900/0xefc4487a018798a8 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a39 expref: 3577 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541533:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099845900, rc 0) 00000100:00100000:3.0:1705683932.541547:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:6496:x1788538641068992:12345-192.168.203.41@tcp:101:dd.0 Request processed in 216us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.541550:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921139 00000100:00100000:1.0:1705683932.541616:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.541629:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541630:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541633:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069120 00000100:00100000:3.0:1705683932.541639:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541640:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.541642:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921141 00000100:00100000:3.0:1705683932.541644:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5964:16443:x1788538641069120:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.541647:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.541691:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d400/0xefc4487a018798af lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a40 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.541699:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.541705:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.541705:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.541715:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d400/0xefc4487a018798af lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a40 expref: 3577 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.541720:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584533888:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.541721:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf5d400/0xefc4487a018798af lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a40 expref: 3577 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.541724:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf5d400, rc 0) 00010000:00010000:1.0:1705683932.541730:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a2b expref: 3577 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.541737:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:7259:x1788538641069056:12345-192.168.203.41@tcp:101:dd.0 Request processed in 330us (379us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.541737:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1240c80, rc 0) 00000100:00100000:0.0:1705683932.541740:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921140 00000100:00100000:1.0:1705683932.541748:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3576:4708:x1788538641068864:12345-192.168.203.41@tcp:101:dd.0 Request processed in 703us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.541752:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921137 00000100:00100000:3.0:1705683932.541832:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584533824:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.541840:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.541852:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:1856:x1788538641068800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 791us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.541856:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333141 00010000:00010000:3.0:1705683932.541867:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a47 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541875:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 3999 pid: 15161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541878:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.541879:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.541880:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a47 expref: 5965 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541888:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 3999 pid: 15161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.541891:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 3999 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.541896:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584534016:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.541909:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.542142:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.542151:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542152:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.542152:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542155:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584533952:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.542156:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069184 00010000:00010000:1.0:1705683932.542164:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.542164:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3502 pid: 15100 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.542172:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542173:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542175:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333143 00000100:00100000:3.0:1705683932.542177:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3502:1856:x1788538641069184:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.542180:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880137669050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3999:1854:x1788538641068736:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 912us (964us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.542181:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.542186:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333142 00010000:00010000:3.0:1705683932.542188:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3502 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.542193:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3502 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.542201:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f22a80/0xefc4487a01847b42 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd5e expref: 3502 pid: 15100 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.542207:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542208:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542209:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a2b expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542213:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a2b expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.542219:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.542222:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1240c80/0xefc4487a0187989a lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a2b expref: 3574 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.542226:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.542226:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584534080:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.542233:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542234:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.542234:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542239:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069248 00000100:00100000:3.0:1705683932.542242:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.542252:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542252:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542252:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542253:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.542253:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542255:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069312 00000100:00100000:3.0:1705683932.542258:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069376 00000100:00100000:1.0:1705683932.542262:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542263:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542266:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069440 00000100:00100000:3.0:1705683932.542268:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542269:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542271:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069504 00000100:00100000:1.0:1705683932.542275:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542276:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542280:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921142 00000100:00100000:0.0:1705683932.542281:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542282:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542283:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3575:6554:x1788538641069248:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.542283:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542283:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542286:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921143 00000100:00100000:0.0:1705683932.542289:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:16415:x1788538641069312:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.542289:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.542289:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921144 00000100:00100000:3.0:1705683932.542291:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:6521:x1788538641069376:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.542294:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.542295:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.542308:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a4e expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542319:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3576 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.542324:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542325:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542327:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a4e expref: 3576 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542339:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3576 pid: 15189 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.542345:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3576 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.542352:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584534144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.542370:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.542378:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542379:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542386:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921145 00000100:00100000:1.0:1705683932.542389:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:7259:x1788538641069440:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.542396:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.542401:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a55 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.542410:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4000 pid: 14398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.542413:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.542414:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.542415:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a55 expref: 5968 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.542423:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4000 pid: 14398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.542426:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4000 pid: 14398 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.542430:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584534208:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.542441:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.542528:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099845400/0xefc4487a018798cb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a5c expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.542536:0:15223:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.542542:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542543:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542545:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099845400/0xefc4487a018798cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a5c expref: 5969 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542549:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099845400/0xefc4487a018798cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a5c expref: 5969 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542553:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099845400, rc 0) 00000100:00100000:3.0:1705683932.542563:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5969:6521:x1788538641069376:12345-192.168.203.41@tcp:101:dd.0 Request processed in 271us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.542566:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921144 00000100:00100000:3.0:1705683932.542575:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542575:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.542578:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921146 00000100:00100000:3.0:1705683932.542579:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:6496:x1788538641069504:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.542582:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.542612:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1243700/0xefc4487a018798d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a63 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.542622:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.542630:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542631:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542634:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1243700/0xefc4487a018798d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a63 expref: 4001 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542642:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1243700/0xefc4487a018798d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a63 expref: 4001 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542647:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1243700, rc 0) 00000100:00100000:1.0:1705683932.542662:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4001:7259:x1788538641069440:12345-192.168.203.41@tcp:101:dd.0 Request processed in 273us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.542667:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921145 00000100:00100000:0.0:1705683932.542700:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.542721:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542722:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542726:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069568 00010000:00010000:1.0:1705683932.542735:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 4001 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.542746:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542746:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.542749:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542749:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333144 00000100:00100000:0.0:1705683932.542750:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.542752:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4001:1857:x1788538641069568:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.542756:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.542759:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 4001 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.542764:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 4001 pid: 15161 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.542775:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542775:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.542777:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a47 expref: 5968 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542782:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a47 expref: 5968 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.542794:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a47 expref: 5968 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.542801:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584534272:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.542813:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099844280/0xefc4487a018798d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a6a expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.542816:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00002000:00010000:3.0:1705683932.542821:0:15223:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9223:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.542826:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542827:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.542829:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099844280/0xefc4487a018798d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a6a expref: 4002 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542834:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099844280/0xefc4487a018798d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a6a expref: 4002 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542838:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099844280, rc 0) 00000100:00100000:3.0:1705683932.542848:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:6496:x1788538641069504:12345-192.168.203.41@tcp:101:dd.0 Request processed in 268us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.542851:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921146 00000100:00100000:3.0:1705683932.542870:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584534080:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.542876:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.542887:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3501:1856:x1788538641069184:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 709us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.542890:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333143 00010000:00010000:3.0:1705683932.542907:0:15169:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf4d680/0xefc4487a017f9b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc638 expref: 4001 pid: 15161 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.542915:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584534016:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.542924:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099846580/0xefc4487a018798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a47 expref: 5968 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.542930:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099846580, rc 0) 00000100:00100000:3.0:1705683932.542945:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5968:16443:x1788538641069120:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1300us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.542950:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921141 00000100:00100000:0.0:1705683932.543396:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.543420:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543421:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543436:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069632 00000100:00100000:3.0:1705683932.543445:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543445:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543448:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921147 00000100:00100000:3.0:1705683932.543450:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4001:4708:x1788538641069632:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.543453:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.543463:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.543474:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.543479:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543479:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543480:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543481:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543483:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069760 00000100:00100000:3.0:1705683932.543483:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069824 00000100:00100000:1.0:1705683932.543487:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1788538584534272:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.543489:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4002 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.543490:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3577 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.543497:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.543498:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.543498:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543500:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333145 00000100:00100000:3.0:1705683932.543502:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1856:x1788538641069824:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.543505:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.543506:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4002 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.543510:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4002 pid: 14398 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.543514:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1857:x1788538641069568:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 761us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.543519:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333144 00010000:00010000:3.0:1705683932.543520:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543521:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543522:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a55 expref: 5967 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543526:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a55 expref: 5967 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.543534:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.543535:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.543535:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a55 expref: 5967 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.543536:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543536:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.543539:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333146 00000100:00100000:3.0:1705683932.543539:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584534336:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.543543:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:1856:x1788538641069760:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.543549:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.543551:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.543554:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a266a80/0xefc4487a0182410f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dac4a expref: 4001 pid: 14398 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.543556:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3577 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.543559:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a71 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.543560:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584534208:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.543562:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3577 pid: 15189 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.543567:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.543569:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135917c00/0xefc4487a018798c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a55 expref: 5967 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543570:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543571:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.543572:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543572:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a71 expref: 4001 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.543573:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135917c00, rc 0) 00010000:00010000:1.0:1705683932.543573:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.543575:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a4e expref: 3577 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543578:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.543580:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a4e expref: 3577 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.543584:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:16415:x1788538641069312:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1295us (1366us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.543586:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.543587:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921143 00000100:00100000:3.0:1705683932.543590:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584534400:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.543594:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a4e expref: 3577 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.543598:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.543601:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584534464:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.543604:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.543616:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.543620:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.543628:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543629:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543632:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.543632:0:15095:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7e580/0xefc4487a018636b1 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2e4 expref: 3577 pid: 15189 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.543632:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069888 00000100:00100000:1.0:1705683932.543641:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584534144:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.543641:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543641:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543643:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069952 00000100:00100000:3.0:1705683932.543647:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543647:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543648:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641069696 00010000:00010000:1.0:1705683932.543649:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1242300/0xefc4487a018798bd lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a4e expref: 3577 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.543654:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543655:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543657:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921148 00010000:00010000:1.0:1705683932.543659:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1242300, rc 0) 00000100:00100000:3.0:1705683932.543659:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3501:6521:x1788538641069888:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.543663:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.543670:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.543670:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:6554:x1788538641069248:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1386us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.543674:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921142 00000100:00100000:0.0:1705683932.543695:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543696:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543699:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070016 00000100:00100000:0.0:1705683932.543720:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543720:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543724:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921149 00000100:00100000:0.0:1705683932.543726:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:6496:x1788538641069952:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.543730:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.543798:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099847200/0xefc4487a018798e7 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a7f expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.543805:0:15223:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.543810:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.543811:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.543811:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543812:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.543814:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099847200/0xefc4487a018798e7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a7f expref: 3503 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.543815:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921150 00000100:00100000:1.0:1705683932.543819:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:7259:x1788538641069696:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.543821:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135916300/0xefc4487a018798ee lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a86 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543822:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099847200/0xefc4487a018798e7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a7f expref: 3503 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.543824:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.543825:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099847200, rc 0) 00002000:00010000:0.0:1705683932.543828:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.543834:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.543835:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.543837:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135916300/0xefc4487a018798ee lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a86 expref: 3578 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.543841:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135916300/0xefc4487a018798ee lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a86 expref: 3578 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.543842:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3503:6521:x1788538641069888:12345-192.168.203.41@tcp:101:dd.0 Request processed in 181us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.543845:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916300, rc 0) 00000100:00100000:3.0:1705683932.543847:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921148 00000100:00100000:3.0:1705683932.543855:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.543855:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.543856:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:6496:x1788538641069952:12345-192.168.203.41@tcp:101:dd.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.543859:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921151 00000100:00100000:0.0:1705683932.543861:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921149 00000100:00100000:3.0:1705683932.543862:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3502:16443:x1788538641070016:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.543868:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.543929:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a8d expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543941:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543946:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.543947:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.543949:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a8d expref: 3503 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543963:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.543974:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.543981:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0000_UUID:15223:1788538584534528:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.543984:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1241680/0xefc4487a018798fc lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a78 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.543994:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.543999:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.544001:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544002:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544005:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1241680/0xefc4487a018798fc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a78 expref: 3578 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544012:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1241680/0xefc4487a018798fc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a78 expref: 3578 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544017:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1241680, rc 0) 00000100:00100000:1.0:1705683932.544033:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:7259:x1788538641069696:12345-192.168.203.41@tcp:101:dd.0 Request processed in 214us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.544037:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921150 00000100:00100000:1.0:1705683932.544149:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584534464:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.544151:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.544154:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584534336:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.544159:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.544162:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.544174:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:1856:x1788538641069760:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 630us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.544175:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4001:1856:x1788538641069824:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 672us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.544178:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333146 00000100:00100000:3.0:1705683932.544181:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333145 00000100:00100000:1.0:1705683932.544187:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544188:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544190:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544191:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070080 00000100:00100000:3.0:1705683932.544191:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.544198:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.544208:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584534400:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.544217:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544218:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.544220:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a71 expref: 4000 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.544228:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099846d00, rc 0) 00000100:00100000:1.0:1705683932.544235:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333147 00000100:00100000:3.0:1705683932.544235:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544236:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544239:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:1856:x1788538641070080:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.544244:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.544252:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.544256:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4000:4708:x1788538641069632:12345-192.168.203.41@tcp:101:dd.0 Request processed in 804us (859us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.544258:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.544261:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921147 00010000:00010000:1.0:1705683932.544270:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391d5400/0xefc4487a01847b49 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd6c expref: 5967 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.544277:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544278:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544280:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a71 expref: 3999 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544285:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a71 expref: 3999 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544298:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099846d00/0xefc4487a018798e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a71 expref: 3999 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.544305:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584534592:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.544321:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.544380:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.544414:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544415:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544419:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070144 00000100:00100000:3.0:1705683932.544428:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544428:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544431:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921152 00000100:00100000:3.0:1705683932.544433:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:16415:x1788538641070144:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.544438:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.544503:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a94 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.544514:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3576 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.544520:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.544521:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.544522:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a94 expref: 3505 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.544534:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3576 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.544539:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3576 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.544544:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584534656:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.544558:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.544589:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.544626:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.544628:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544629:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544632:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.544632:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070208 00000100:00100000:1.0:1705683932.544642:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544643:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.544643:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544645:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070272 00000100:00100000:1.0:1705683932.544651:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544651:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544653:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070400 00000100:00100000:3.0:1705683932.544657:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0000_UUID:15223:1788538584534528:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.544659:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.544668:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544669:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.544671:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a8d expref: 3505 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.544672:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333148 00000100:00100000:1.0:1705683932.544674:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:1854:x1788538641070400:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.544679:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.544681:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.544683:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099846a80, rc 0) 00010000:00010000:1.0:1705683932.544690:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.544699:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3505:16443:x1788538641070016:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 837us (1029us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.544700:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801332de080/0xefc4487a017f9ce7 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc67e expref: 3577 pid: 15186 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.544703:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921151 00010000:00010000:1.0:1705683932.544707:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544720:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544722:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a8d expref: 3505 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.544723:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.544724:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544725:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.544726:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a8d expref: 3504 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.544729:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070336 00000100:00100000:3.0:1705683932.544736:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544737:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544738:0:15223:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070464 00010000:00010000:1.0:1705683932.544739:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099846a80/0xefc4487a018798f5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6684:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a8d expref: 3504 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.544742:0:15223:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544742:0:15223:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544745:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cc100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584534720:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.544745:0:15223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921153 00000100:00100000:3.0:1705683932.544747:0:15223:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:6554:x1788538641070208:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.544751:0:15223:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.544761:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.544767:0:15223:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301a9b expref: -99 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.544773:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584534592:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.544779:0:15223:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4003 pid: 15191 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.544781:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.544784:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.544784:0:15223:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.544786:0:15223:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a9b expref: 4003 pid: 15223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.544795:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:1856:x1788538641070080:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 555us (644us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.544798:0:15223:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4003 pid: 15191 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.544800:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333147 00010000:00010000:3.0:1705683932.544805:0:15223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4003 pid: 15191 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.544812:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.544813:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544813:0:15223:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584534784:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.544818:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921154 00000100:00100000:1.0:1705683932.544821:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:6496:x1788538641070336:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.544827:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.544834:0:15223:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.544845:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544846:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.544851:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921155 00000100:00100000:3.0:1705683932.544855:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:7259:x1788538641070464:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.544861:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.544883:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.544921:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544922:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544925:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070528 00000100:00100000:0.0:1705683932.544933:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544934:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.544937:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921156 00000100:00100000:0.0:1705683932.544938:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:4708:x1788538641070528:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.544942:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.544966:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1240000/0xefc4487a01879911 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301aa9 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.544975:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9224:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.544983:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544984:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.544986:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1240000/0xefc4487a01879911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aa9 expref: 4004 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544993:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1240000/0xefc4487a01879911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aa9 expref: 4004 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.544998:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1240000, rc 0) 00000100:00100000:1.0:1705683932.545015:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:6496:x1788538641070336:12345-192.168.203.41@tcp:101:dd.0 Request processed in 194us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.545019:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921154 00010000:00010000:0.0:1705683932.545025:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ab7 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.545034:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.545037:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.545038:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.545038:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.545039:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab7 expref: 3578 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.545039:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545042:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921157 00000100:00100000:1.0:1705683932.545045:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5966:6521:x1788538641070272:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.545047:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.545050:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.545051:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.545104:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584534848:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.545116:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.545167:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.545217:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545218:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545221:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070592 00010000:00010000:3.0:1705683932.545230:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3579 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.545242:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545242:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545246:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333149 00000100:00100000:3.0:1705683932.545249:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4293050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:1856:x1788538641070592:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.545255:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.545257:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3579 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.545259:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cc100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584534720:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.545264:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.545264:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3579 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.545269:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.545269:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.545270:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.545273:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070656 00010000:00010000:3.0:1705683932.545281:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.545282:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.545283:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:1854:x1788538641070400:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 607us (638us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.545284:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a94 expref: 3504 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.545288:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333148 00010000:00010000:3.0:1705683932.545289:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a94 expref: 3504 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545305:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a94 expref: 3504 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.545307:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1243480/0xefc4487a0187991f lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301aa2 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.545312:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584534912:192.168.203.41@tcp:105: 00002000:00010000:1.0:1705683932.545316:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.545324:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.545325:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.545326:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800871c5600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.545327:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1243480/0xefc4487a0187991f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aa2 expref: 5967 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.545329:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4004 pid: 15191 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.545333:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1243480/0xefc4487a0187991f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aa2 expref: 5967 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.545339:0:15223:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_110:lustre-OST0001_UUID:15223:1788538584534784:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.545340:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1243480, rc 0) 00000100:00100000:0.0:1705683932.545342:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.545342:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.545345:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333150 00000100:00100000:0.0:1705683932.545347:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:1856:x1788538641070656:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.545348:0:15223:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a9b expref: 4004 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.545351:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.545353:0:15223:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099844f00, rc 0) 00010000:00010000:0.0:1705683932.545356:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4004 pid: 15191 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.545360:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4004 pid: 15191 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.545361:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:6521:x1788538641070272:12345-192.168.203.41@tcp:101:dd.0 Request processed in 314us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.545362:0:15223:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:6554:x1788538641070208:12345-192.168.203.41@tcp:101:dd.0 Request processed in 615us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.545365:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921157 00010000:00010000:0.0:1705683932.545368:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354ae080/0xefc4487a018636c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2eb expref: 4004 pid: 15191 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.545368:0:15223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921153 00010000:00010000:0.0:1705683932.545374:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.545374:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.545376:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a9b expref: 4002 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.545379:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a9b expref: 4002 pid: 15223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545384:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099846080/0xefc4487a01879926 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ab0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.545388:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099844f00/0xefc4487a0187990a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a9b expref: 4002 pid: 15223 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.545391:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.545393:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584534976:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.545397:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.545397:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.545399:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099846080/0xefc4487a01879926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab0 expref: 4003 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545403:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099846080/0xefc4487a01879926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab0 expref: 4003 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.545405:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.545407:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099846080, rc 0) 00000100:00100000:3.0:1705683932.545414:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:7259:x1788538641070464:12345-192.168.203.41@tcp:101:dd.0 Request processed in 560us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.545417:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921155 00000100:00100000:1.0:1705683932.545418:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.545426:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545426:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545430:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070720 00000100:00100000:3.0:1705683932.545439:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545440:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545443:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921158 00000100:00100000:3.0:1705683932.545445:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5967:16443:x1788538641070720:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.545451:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.545542:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301abe expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545552:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545555:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.545556:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.545557:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301abe expref: 5968 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545566:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545572:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.545579:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584535040:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.545582:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584534848:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.545593:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab7 expref: 3578 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.545601:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135914780, rc 0) 00000100:00100000:3.0:1705683932.545601:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.545615:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:4708:x1788538641070528:12345-192.168.203.41@tcp:101:dd.0 Request processed in 676us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.545623:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921156 00010000:00010000:3.0:1705683932.545629:0:15169:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800737c7480/0xefc4487a0182442d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dad2a expref: 3577 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.545639:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584534656:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.545649:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099847480/0xefc4487a01879903 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301a94 expref: 3504 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545656:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099847480, rc 0) 00000100:00100000:3.0:1705683932.545670:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:16415:x1788538641070144:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1236us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.545676:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921152 00000100:00100000:0.0:1705683932.545763:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.545770:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545771:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545775:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070784 00010000:00010000:1.0:1705683932.545783:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.545790:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.545793:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545794:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545796:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333151 00000100:00100000:3.0:1705683932.545798:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.545799:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:1857:x1788538641070784:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.545799:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.545803:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.545803:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070848 00010000:00010000:1.0:1705683932.545809:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.545813:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.545813:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545814:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.545816:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921159 00000100:00100000:3.0:1705683932.545818:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:6496:x1788538641070848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.545820:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982bd180/0xefc4487a01847b5e lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd73 expref: 3504 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.545823:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.545825:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.545826:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.545827:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab7 expref: 3577 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.545830:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab7 expref: 3577 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.545839:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135914780/0xefc4487a01879918 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ab7 expref: 3577 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.545844:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584535104:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.545860:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.545901:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b02800/0xefc4487a01879934 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ac5 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.545911:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.545920:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.545921:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.545924:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b02800/0xefc4487a01879934 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ac5 expref: 3578 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545931:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b02800/0xefc4487a01879934 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ac5 expref: 3578 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.545936:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b02800, rc 0) 00000100:00100000:3.0:1705683932.545951:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:6496:x1788538641070848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 131us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.545955:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921159 00000100:00100000:3.0:1705683932.546052:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584534912:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.546056:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.546062:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.546083:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.546098:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584534976:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.546101:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4293050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3577:1856:x1788538641070592:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 850us (933us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.546105:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.546106:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333149 00000100:00100000:0.0:1705683932.546115:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1856:x1788538641070656:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 767us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.546119:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333150 00000100:00100000:1.0:1705683932.546138:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.546151:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546152:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546157:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070912 00000100:00100000:3.0:1705683932.546166:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546167:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546169:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641070976 00000100:00100000:3.0:1705683932.546173:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546173:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546174:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071040 00000100:00100000:3.0:1705683932.546178:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546178:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546180:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921160 00000100:00100000:3.0:1705683932.546182:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:7259:x1788538641070912:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.546186:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.546255:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.546298:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.546344:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546345:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546348:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071168 00000100:00100000:0.0:1705683932.546360:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546361:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546364:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921161 00000100:00100000:0.0:1705683932.546366:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:6521:x1788538641070976:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.546370:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.546375:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584535104:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.546384:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.546396:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546397:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:1857:x1788538641070784:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 598us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.546398:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546402:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333151 00000100:00100000:3.0:1705683932.546402:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071104 00000100:00100000:1.0:1705683932.546413:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.546413:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.546414:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546418:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921162 00000100:00100000:1.0:1705683932.546421:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3578:6554:x1788538641071040:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.546434:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546436:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546436:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546437:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546440:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333152 00000100:00100000:3.0:1705683932.546443:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4002:1856:x1788538641071104:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.546447:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.546449:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135916a80/0xefc4487a0187993b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ad3 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546449:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.546451:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.546456:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4002 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.546465:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.546466:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546468:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ada expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546468:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301abe expref: 5969 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546478:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301abe expref: 5969 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.546479:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.546484:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546484:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546486:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ada expref: 3579 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546493:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301abe expref: 5969 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.546496:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.546498:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.546500:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584535168:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.546503:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.546503:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546504:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.546506:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135916a80/0xefc4487a0187993b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ad3 expref: 3504 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.546511:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584535232:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.546513:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135916a80/0xefc4487a0187993b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ad3 expref: 3504 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.546517:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916a80, rc 0) 00000100:00100000:3.0:1705683932.546517:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.546526:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b02a80/0xefc4487a01879949 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301acc expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.546527:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00002000:00010000:3.0:1705683932.546534:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.546540:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.546541:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.546542:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b02a80/0xefc4487a01879949 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301acc expref: 3580 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546547:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b02a80/0xefc4487a01879949 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301acc expref: 3580 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546551:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b02a80, rc 0) 00000100:00100000:0.0:1705683932.546561:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cda00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:6521:x1788538641070976:12345-192.168.203.41@tcp:101:dd.0 Request processed in 193us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.546561:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ce400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3580:7259:x1788538641070912:12345-192.168.203.41@tcp:101:dd.0 Request processed in 378us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.546564:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921161 00000100:00100000:3.0:1705683932.546566:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921160 00000100:00100000:1.0:1705683932.546570:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.546571:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546571:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546572:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.546573:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546575:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071232 00000100:00100000:3.0:1705683932.546576:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921163 00000100:00100000:3.0:1705683932.546578:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5969:16415:x1788538641071168:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.546583:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.546588:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546589:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546591:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921164 00000100:00100000:1.0:1705683932.546591:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546591:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.546592:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:6496:x1788538641071232:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.546596:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.546608:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.546614:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546615:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546618:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071296 00000100:00100000:1.0:1705683932.546629:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546629:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.546632:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921165 00000100:00100000:1.0:1705683932.546634:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:4708:x1788538641071296:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.546640:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.546669:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301aef expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.546683:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5969 pid: 15188 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.546688:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546688:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.546690:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aef expref: 4005 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546691:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ae1 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546701:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4005 pid: 15117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.546703:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.546704:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.546705:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.546706:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae1 expref: 5970 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.546722:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.546727:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4005 pid: 15117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.546729:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584535296:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.546732:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4005 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.546737:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584535360:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.546745:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.546749:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.546765:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a7ab980/0xefc4487a017f9f9c lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc6bd expref: 4005 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.546771:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584535040:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.546778:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099847700/0xefc4487a0187992d lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301abe expref: 5970 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.546782:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099847700, rc 0) 00000100:00100000:3.0:1705683932.546792:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:16443:x1788538641070720:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1346us (1376us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.546793:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135914c80/0xefc4487a0187995e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ae8 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.546795:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921158 00002000:00010000:0.0:1705683932.546800:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9225:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.546805:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.546806:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.546807:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135914c80/0xefc4487a0187995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae8 expref: 4005 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.546812:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135914c80/0xefc4487a0187995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae8 expref: 4005 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.546818:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135914c80, rc 0) 00000100:00100000:0.0:1705683932.546831:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:6496:x1788538641071232:12345-192.168.203.41@tcp:101:dd.0 Request processed in 238us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.546834:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921164 00000100:00100000:1.0:1705683932.547275:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8ccb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15095:1788538584535232:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.547283:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584535168:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.547287:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ada expref: 3579 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.547291:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.547293:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1241180, rc 0) 00000100:00100000:3.0:1705683932.547303:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:1856:x1788538641071104:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 860us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.547307:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333152 00000100:00100000:1.0:1705683932.547309:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cb700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:6554:x1788538641071040:12345-192.168.203.41@tcp:101:dd.0 Request processed in 887us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.547313:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921162 00000100:00100000:0.0:1705683932.547363:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.547373:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547373:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547376:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071360 00010000:00010000:3.0:1705683932.547381:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.547394:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547395:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547396:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333153 00000100:00100000:3.0:1705683932.547398:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:1857:x1788538641071360:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.547402:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.547407:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.547412:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.547420:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca7ed00/0xefc4487a018636f0 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f2 expref: 3579 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.547428:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.547429:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.547430:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ada expref: 3578 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.547433:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584535296:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.547434:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.547434:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ada expref: 3578 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.547442:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1241180/0xefc4487a01879942 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ada expref: 3578 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.547443:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aef expref: 4003 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.547446:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584535424:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.547450:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1241e00, rc 0) 00000100:00100000:3.0:1705683932.547460:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.547463:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:4708:x1788538641071296:12345-192.168.203.41@tcp:101:dd.0 Request processed in 827us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.547466:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921165 00000100:00100000:3.0:1705683932.547472:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0001_UUID:15215:1788538584535360:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.547474:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547474:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547477:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071424 00010000:00010000:3.0:1705683932.547480:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae1 expref: 5970 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.547485:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.547485:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b03700, rc 0) 00000100:00100000:1.0:1705683932.547486:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547489:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.547489:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921166 00000100:00100000:1.0:1705683932.547492:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:6521:x1788538641071424:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.547493:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:16415:x1788538641071168:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 914us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.547497:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921163 00000100:00100000:1.0:1705683932.547502:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547502:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547505:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071488 00010000:00010000:1.0:1705683932.547510:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.547524:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547524:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547527:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547527:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333154 00000100:00100000:0.0:1705683932.547528:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547530:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:1854:x1788538641071488:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.547535:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.547540:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.547550:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.547560:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008497f480/0xefc4487a01847b57 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd7a expref: 5970 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.547568:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.547569:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.547570:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aef expref: 4002 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.547575:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aef expref: 4002 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.547588:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1241e00/0xefc4487a01879950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301aef expref: 4002 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.547595:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584535488:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.547611:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.547613:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.547619:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547619:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.547621:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.547622:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071552 00010000:00010000:0.0:1705683932.547629:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4003 pid: 15117 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.547720:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547721:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547724:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333155 00000100:00100000:0.0:1705683932.547726:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:1854:x1788538641071552:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.547730:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.547732:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4003 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.547736:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4003 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.547747:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099af4500/0xefc4487a0182474b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2dadee expref: 4003 pid: 15117 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.547753:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.547754:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.547755:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae1 expref: 5969 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.547758:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae1 expref: 5969 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.547767:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135b03700/0xefc4487a01879957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ae1 expref: 5969 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.547771:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584535552:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.547774:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8c780/0xefc4487a01879965 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301af6 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.547781:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00002000:00010000:1.0:1705683932.547784:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.547791:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.547792:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.547795:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8c780/0xefc4487a01879965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301af6 expref: 5970 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.547801:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8c780/0xefc4487a01879965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301af6 expref: 5970 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.547803:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.547807:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8c780, rc 0) 00000100:00100000:1.0:1705683932.547821:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:6521:x1788538641071424:12345-192.168.203.41@tcp:101:dd.0 Request processed in 328us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.547826:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921166 00000100:00100000:0.0:1705683932.547830:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.547844:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547845:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547848:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071616 00000100:00100000:3.0:1705683932.547853:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547854:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547857:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071680 00000100:00100000:1.0:1705683932.547859:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547860:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.547864:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921167 00000100:00100000:1.0:1705683932.547867:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:6496:x1788538641071616:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.547871:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.547871:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.547872:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.547873:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.547874:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921168 00000100:00100000:3.0:1705683932.547876:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3504:16443:x1788538641071680:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.547880:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.547882:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547882:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547886:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071744 00000100:00100000:0.0:1705683932.547894:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547894:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.547896:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921169 00000100:00100000:0.0:1705683932.547898:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4003:7259:x1788538641071744:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.547904:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.547989:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135916800/0xefc4487a0187996c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b0b expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.548038:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.548045:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.548045:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.548048:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135916800/0xefc4487a0187996c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b0b expref: 4004 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.548052:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135916800/0xefc4487a0187996c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b0b expref: 4004 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.548056:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916800, rc 0) 00000100:00100000:0.0:1705683932.548067:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:7259:x1788538641071744:12345-192.168.203.41@tcp:101:dd.0 Request processed in 168us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.548070:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921169 00010000:00010000:3.0:1705683932.548098:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b04 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548099:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8c000/0xefc4487a0187997a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301afd expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.548107:0:15215:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3579 pid: 15186 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.548108:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.548111:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.548111:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.548112:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b04 expref: 3505 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548115:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548116:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548119:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8c000/0xefc4487a0187997a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301afd expref: 3580 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.548121:0:15215:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3580 pid: 15186 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.548125:0:15215:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3580 pid: 15186 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.548126:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8c000/0xefc4487a0187997a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301afd expref: 3580 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.548129:0:15215:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584535616:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.548131:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8c000, rc 0) 00000100:00100000:3.0:1705683932.548142:0:15215:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.548148:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3580:6496:x1788538641071616:12345-192.168.203.41@tcp:101:dd.0 Request processed in 280us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.548152:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921167 00000100:00100000:3.0:1705683932.548174:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584535424:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.548181:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.548184:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.548191:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548191:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:1857:x1788538641071360:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 792us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.548192:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548195:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071808 00000100:00100000:3.0:1705683932.548197:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333153 00000100:00100000:1.0:1705683932.548214:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584535488:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.548220:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.548230:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5969:1854:x1788538641071488:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 700us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.548234:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333154 00000100:00100000:0.0:1705683932.548242:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584535552:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.548242:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548243:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548246:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921170 00000100:00100000:1.0:1705683932.548248:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:6554:x1788538641071808:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.548249:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.548253:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.548256:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:1854:x1788538641071552:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 530us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.548259:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333155 00010000:00010000:1.0:1705683932.548270:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b12 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548279:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4004 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.548284:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548285:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548286:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b12 expref: 4004 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548296:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4004 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.548302:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4004 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.548308:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584535680:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.548323:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.548377:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.548386:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548386:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548412:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071872 00000100:00100000:1.0:1705683932.548424:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548424:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548427:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921171 00000100:00100000:1.0:1705683932.548429:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3506:6521:x1788538641071872:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.548433:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.548437:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.548445:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548446:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548451:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641071936 00000100:00100000:3.0:1705683932.548461:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548462:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548464:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921172 00000100:00100000:3.0:1705683932.548466:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d335a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3579:4708:x1788538641071936:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.548471:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.548612:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b20 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548613:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8c280/0xefc4487a01879988 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b19 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.548622:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.548626:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3507 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.548630:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548631:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.548631:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.548632:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548634:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8c280/0xefc4487a01879988 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b19 expref: 3507 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.548634:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b20 expref: 3580 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548641:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8c280/0xefc4487a01879988 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b19 expref: 3507 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548646:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8c280, rc 0) 00010000:00010000:3.0:1705683932.548647:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3507 pid: 15106 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.548654:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3507 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.548663:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3507:6521:x1788538641071872:12345-192.168.203.41@tcp:101:dd.0 Request processed in 232us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.548665:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584535744:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.548668:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921171 00000100:00100000:0.0:1705683932.548674:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.548683:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548683:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.548684:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548700:0:15215:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_102:lustre-OST0000_UUID:15215:1788538584535616:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.548720:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b04 expref: 3506 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.548726:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b02300, rc 0) 00000100:00100000:0.0:1705683932.548729:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072000 00000100:00100000:3.0:1705683932.548735:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3506:16443:x1788538641071680:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 858us (904us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.548736:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3581 pid: 15186 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.548738:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921168 00000100:00100000:0.0:1705683932.548744:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.548744:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.548746:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333156 00000100:00100000:0.0:1705683932.548748:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:1857:x1788538641072000:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.548752:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.548753:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3581 pid: 15186 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.548757:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3581 pid: 15186 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.548764:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9c0000/0xefc4487a017fa2f9 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc70a expref: 3581 pid: 15186 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.548771:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.548772:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.548773:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b04 expref: 3505 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.548776:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b04 expref: 3505 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.548785:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135b02300/0xefc4487a01879973 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6685:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b04 expref: 3505 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.548790:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d333700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584535808:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.548802:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.548834:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.548836:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584535680:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.548844:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b12 expref: 4004 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548851:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8e300, rc 0) 00000100:00100000:0.0:1705683932.548853:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.548854:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548855:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548859:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072064 00000100:00100000:1.0:1705683932.548862:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548862:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548866:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072128 00000100:00100000:3.0:1705683932.548868:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548869:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.548871:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921173 00010000:00010000:1.0:1705683932.548872:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4005 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.548873:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:7259:x1788538641072064:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.548877:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.548889:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548890:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.548893:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.548893:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333157 00000100:00100000:1.0:1705683932.548896:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:1856:x1788538641072128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.548901:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.548907:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4005 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.548912:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4005 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.548926:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008b2ca300/0xefc4487a018636f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb2f9 expref: 4005 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.548933:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548934:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.548936:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b12 expref: 4004 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548941:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b12 expref: 4004 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.548953:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097f8e300/0xefc4487a01879981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b12 expref: 4004 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.548959:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584535872:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.548975:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.548983:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ccb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:6554:x1788538641071808:12345-192.168.203.41@tcp:101:dd.0 Request processed in 734us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.548988:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921170 00000100:00100000:1.0:1705683932.548994:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548995:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.548998:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072192 00000100:00100000:1.0:1705683932.549006:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549007:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549009:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921174 00000100:00100000:0.0:1705683932.549010:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549011:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549012:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d336e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3506:16415:x1788538641072192:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.549019:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.549101:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b27 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549113:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3581 pid: 15181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549117:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.549118:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.549119:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207ed00/0xefc4487a0187999d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b2e expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549120:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b27 expref: 3507 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.549127:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.549132:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.549132:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3582 pid: 15181 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.549134:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.549136:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.549138:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207ed00/0xefc4487a0187999d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b2e expref: 3582 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549139:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3582 pid: 15181 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.549143:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207ed00/0xefc4487a0187999d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b2e expref: 3582 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.549145:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584535936:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.549147:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207ed00, rc 0) 00000100:00100000:1.0:1705683932.549165:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.549167:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:7259:x1788538641072064:12345-192.168.203.41@tcp:101:dd.0 Request processed in 292us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.549171:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921173 00000100:00100000:1.0:1705683932.549173:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549174:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549178:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072256 00000100:00100000:1.0:1705683932.549190:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549190:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549194:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921175 00000100:00100000:1.0:1705683932.549196:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:6496:x1788538641072256:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.549201:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.549319:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8c500/0xefc4487a018799a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b35 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.549329:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9226:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.549336:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.549337:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.549340:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8c500/0xefc4487a018799a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b35 expref: 4005 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549346:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8c500/0xefc4487a018799a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b35 expref: 4005 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549351:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8c500, rc 0) 00000100:00100000:1.0:1705683932.549368:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:6496:x1788538641072256:12345-192.168.203.41@tcp:101:dd.0 Request processed in 170us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.549372:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921175 00000100:00100000:0.0:1705683932.549545:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.549551:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d333700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584535808:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.549555:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.549560:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.549560:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584535744:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.549562:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.549575:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:1857:x1788538641072000:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 825us (901us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.549575:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b20 expref: 3581 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.549580:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333156 00010000:00010000:3.0:1705683932.549582:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b01680, rc 0) 00000100:00100000:3.0:1705683932.549590:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549591:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549595:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072448 00010000:00010000:3.0:1705683932.549604:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3508 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.549617:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584535872:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.549617:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549618:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549621:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333158 00000100:00100000:3.0:1705683932.549624:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d334600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3508:1856:x1788538641072448:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.549625:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.549628:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.549634:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3508 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.549640:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:1856:x1788538641072128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 743us (786us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.549642:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3508 pid: 15106 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.549644:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333157 00010000:00010000:3.0:1705683932.549650:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099839400/0xefc4487a01847ba4 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd81 expref: 3508 pid: 15106 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.549657:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.549657:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.549659:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b20 expref: 3580 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.549663:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b20 expref: 3580 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.549666:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584535936:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.549668:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.549677:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135b01680/0xefc4487a0187998f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b20 expref: 3580 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549678:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b27 expref: 3507 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549684:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8ea80, rc 0) 00000100:00100000:3.0:1705683932.549684:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584536000:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.549697:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d336e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3507:16415:x1788538641072192:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 684us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.549701:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.549701:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921174 00000100:00100000:3.0:1705683932.549702:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.549720:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549721:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549726:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072320 00000100:00100000:1.0:1705683932.549728:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549729:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549733:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072576 00000100:00100000:3.0:1705683932.549739:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549740:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549742:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.549742:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3581 pid: 15181 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.549743:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072384 00000100:00100000:0.0:1705683932.549752:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549752:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549753:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549753:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549753:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549754:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549756:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333159 00000100:00100000:3.0:1705683932.549757:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072512 00000100:00100000:0.0:1705683932.549758:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072640 00000100:00100000:1.0:1705683932.549759:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d337300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:1857:x1788538641072576:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.549764:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.549764:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549764:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.549766:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3582 pid: 15181 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.549767:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921176 00000100:00100000:0.0:1705683932.549769:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549769:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.549769:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d331900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:6521:x1788538641072320:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.549772:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921177 00010000:00010000:1.0:1705683932.549772:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3582 pid: 15181 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.549773:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.549774:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:6554:x1788538641072384:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.549779:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.549782:0:15238:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097fd2a80/0xefc4487a01824974 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daeb9 expref: 3582 pid: 15181 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.549792:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b43 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549794:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.549795:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.549797:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b27 expref: 3506 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.549800:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.549802:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b27 expref: 3506 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.549806:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.549807:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.549808:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b43 expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.549816:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.549816:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097f8ea80/0xefc4487a01879996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b27 expref: 3506 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.549819:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.549823:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d336900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584536128:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.549823:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584536064:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.549838:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.549847:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549847:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.549852:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921178 00000100:00100000:1.0:1705683932.549855:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d331e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5970:16443:x1788538641072512:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.549861:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.549887:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.549895:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549895:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.549899:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921179 00000100:00100000:0.0:1705683932.549901:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d334b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4004:7259:x1788538641072640:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.549905:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.549940:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b4a expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549952:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4004 pid: 15097 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549956:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.549957:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.549958:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b4a expref: 5971 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549968:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4004 pid: 15097 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.549974:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4004 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.549979:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584536192:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.549993:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.550126:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.550133:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550134:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550138:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072704 00000100:00100000:3.0:1705683932.550148:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550148:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550151:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921180 00000100:00100000:3.0:1705683932.550153:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:6496:x1788538641072704:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.550156:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.550197:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135916d00/0xefc4487a018799b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x965f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b51 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.550204:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x965f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.550210:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.550210:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.550212:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135916d00/0xefc4487a018799b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b51 expref: 4005 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550219:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135916d00/0xefc4487a018799b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x965f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b51 expref: 4005 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550223:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916d00, rc 0) 00000100:00100000:0.0:1705683932.550232:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d334b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:7259:x1788538641072640:12345-192.168.203.41@tcp:101:dd.0 Request processed in 331us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.550235:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921179 00010000:00010000:3.0:1705683932.550274:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207c000/0xefc4487a018799c0 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b58 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.550281:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.550287:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550288:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550290:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207c000/0xefc4487a018799c0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b58 expref: 3584 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.550295:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207c000/0xefc4487a018799c0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b58 expref: 3584 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.550298:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207c000, rc 0) 00000100:00100000:3.0:1705683932.550313:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:6496:x1788538641072704:12345-192.168.203.41@tcp:101:dd.0 Request processed in 160us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.550321:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921180 00010000:00010000:3.0:1705683932.550341:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013207c280/0xefc4487a018799c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b3c expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.550351:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.550358:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550359:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550362:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207c280/0xefc4487a018799c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b3c expref: 5972 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.550369:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013207c280/0xefc4487a018799c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b3c expref: 5972 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.550373:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207c280, rc 0) 00000100:00100000:3.0:1705683932.550386:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d331900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:6521:x1788538641072320:12345-192.168.203.41@tcp:101:dd.0 Request processed in 616us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.550389:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921176 00000100:00100000:3.0:1705683932.550400:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d335a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:4708:x1788538641071936:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1934us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.550403:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921172 00000100:00100000:0.0:1705683932.550751:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.550758:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584536000:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.550766:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.550775:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584536064:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.550780:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.550782:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d334600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3506:1856:x1788538641072448:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1158us (1219us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.550785:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.550785:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333158 00000100:00100000:0.0:1705683932.550789:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.550789:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550791:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550792:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.550793:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072768 00000100:00100000:3.0:1705683932.550794:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072832 00000100:00100000:1.0:1705683932.550799:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d337300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:1857:x1788538641072576:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1039us (1098us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.550800:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3583 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.550800:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4005 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.550804:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333159 00000100:00100000:3.0:1705683932.550809:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550810:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.550812:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.550813:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.550813:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333160 00000100:00100000:3.0:1705683932.550814:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:1857:x1788538641072832:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.550815:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333161 00000100:00100000:1.0:1705683932.550815:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.550815:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.550817:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:1854:x1788538641072768:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.550818:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.550819:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4005 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.550820:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.550823:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4005 pid: 15097 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.550826:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.550830:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.550831:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d336900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584536128:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.550832:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550832:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550834:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b4a expref: 5971 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.550837:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b4a expref: 5971 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550840:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b2ca580/0xefc4487a018637c9 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb315 expref: 3582 pid: 15188 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.550845:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.550846:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.550846:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b4a expref: 5971 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550847:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b43 expref: 3581 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550851:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b43 expref: 3581 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.550851:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584536256:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.550855:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b43 expref: 3581 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.550860:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135916080/0xefc4487a018799ab lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b43 expref: 3581 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.550862:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916080, rc 0) 00000100:00100000:3.0:1705683932.550862:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.550864:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009d332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584536320:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.550877:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.550877:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d332d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:6554:x1788538641072384:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1102us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.550884:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921177 00010000:00010000:1.0:1705683932.550906:0:15148:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133c3ea80/0xefc4487a017faad2 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cc830 expref: 4005 pid: 15097 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.550914:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584536192:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.550923:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8cc80/0xefc4487a018799b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b4a expref: 5971 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.550929:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8cc80, rc 0) 00000100:00100000:1.0:1705683932.550946:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d331e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5971:16443:x1788538641072512:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1090us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.550950:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921178 00000100:00100000:0.0:1705683932.551204:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.551215:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.551221:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551222:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.551225:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.551227:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072896 00000100:00100000:1.0:1705683932.551239:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551240:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551241:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641072960 00000100:00100000:1.0:1705683932.551248:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551249:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551250:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073024 00000100:00100000:1.0:1705683932.551258:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551258:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551261:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921181 00000100:00100000:0.0:1705683932.551262:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.551263:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551264:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d330a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4005:4708:x1788538641072896:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.551267:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921182 00000100:00100000:0.0:1705683932.551269:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3506:6521:x1788538641072960:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.551269:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.551273:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.551281:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551282:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551289:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921183 00000100:00100000:3.0:1705683932.551293:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d335000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:7259:x1788538641073024:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.551296:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b5f expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.551300:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.551310:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5970 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.551314:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.551315:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.551316:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b5f expref: 4006 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.551329:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5970 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.551335:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5970 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.551341:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584536384:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.551360:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.551369:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207db80/0xefc4487a018799d5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b6d expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.551379:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.551386:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.551387:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.551390:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207db80/0xefc4487a018799d5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b6d expref: 3582 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.551395:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207db80/0xefc4487a018799d5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b6d expref: 3582 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.551397:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135915680/0xefc4487a018799dc lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b66 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.551399:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207db80, rc 0) 00000100:00100000:3.0:1705683932.551414:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d335000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:7259:x1788538641073024:12345-192.168.203.41@tcp:101:dd.0 Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.551417:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921183 00002000:00010000:0.0:1705683932.551442:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.551448:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.551449:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.551451:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135915680/0xefc4487a018799dc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b66 expref: 3507 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.551456:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135915680/0xefc4487a018799dc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b66 expref: 3507 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.551459:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135915680, rc 0) 00000100:00100000:0.0:1705683932.551470:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3507:6521:x1788538641072960:12345-192.168.203.41@tcp:101:dd.0 Request processed in 201us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.551473:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921182 00000100:00100000:1.0:1705683932.551509:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009d332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584536320:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.551516:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.551527:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:1854:x1788538641072768:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 709us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.551531:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333161 00000100:00100000:0.0:1705683932.551595:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.551603:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551604:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551606:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073088 00000100:00100000:3.0:1705683932.551607:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584536256:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.551608:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.551616:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551616:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.551617:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.551618:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073152 00000100:00100000:1.0:1705683932.551624:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551625:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551627:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921184 00000100:00100000:3.0:1705683932.551627:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4007:1857:x1788538641072832:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 812us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.551630:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5971:16415:x1788538641073088:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.551631:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333160 00010000:00010000:1.0:1705683932.551635:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.551636:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.551641:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551642:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551645:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073216 00000100:00100000:3.0:1705683932.551653:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551654:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551656:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921185 00000100:00100000:3.0:1705683932.551658:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d336900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4006:6554:x1788538641073152:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.551663:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.551665:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.551860:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b74 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.551871:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4006 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.551875:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.551876:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.551877:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b74 expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.551886:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b7b expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.551887:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4006 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.551892:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4007 pid: 14216 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.551896:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4007 pid: 15109 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.551898:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584536448:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.551900:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.551901:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.551902:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b7b expref: 4007 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.551911:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4007 pid: 15109 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.551916:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4007 pid: 15109 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.551919:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.551921:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584536512:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.551926:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551927:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551931:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073280 00000100:00100000:3.0:1705683932.551934:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.551941:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551942:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551942:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.551943:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.551946:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921186 00000100:00100000:1.0:1705683932.551950:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d333700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3507:16443:x1788538641073216:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.551951:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921187 00000100:00100000:3.0:1705683932.551953:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:6496:x1788538641073280:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.551956:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.551957:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.552049:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.552064:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b82 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552091:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3580 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552096:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.552097:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.552098:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b82 expref: 3508 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552109:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3580 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552114:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3580 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.552115:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552116:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552119:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073344 00000100:00100000:1.0:1705683932.552120:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584536576:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.552127:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5973 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.552136:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.552138:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552139:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552141:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333162 00000100:00100000:3.0:1705683932.552142:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5973:1857:x1788538641073344:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.552147:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.552149:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584536384:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.552153:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5973 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.552157:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b5f expref: 4008 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552158:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5973 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.552166:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.552166:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009def1b80/0xefc4487a01847b7a lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd88 expref: 5973 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.552167:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.552168:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.552170:0:15110:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b5f expref: 4008 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552175:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b5f expref: 4008 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552180:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.552185:0:15110:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097f8e800/0xefc4487a018799ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b5f expref: 4008 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.552190:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584536640:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.552190:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:1857:x1788538641073344:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.552193:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333162 00000100:00100000:0.0:1705683932.552202:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.552202:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013207ea80/0xefc4487a018799f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9227:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b89 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.552203:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.552204:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.552206:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073408 00002000:00010000:3.0:1705683932.552210:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9227:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.552214:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552215:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.552215:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.552216:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.552217:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921188 00010000:00010000:3.0:1705683932.552218:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207ea80/0xefc4487a018799f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b89 expref: 4010 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.552219:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:7259:x1788538641073408:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.552222:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013207ea80/0xefc4487a018799f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b89 expref: 4010 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.552224:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.552226:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207ea80, rc 0) 00000100:00100000:3.0:1705683932.552234:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:6496:x1788538641073280:12345-192.168.203.41@tcp:101:dd.0 Request processed in 281us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.552237:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921187 00000100:00100000:1.0:1705683932.552312:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.552334:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552335:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552338:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073472 00000100:00100000:3.0:1705683932.552345:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552346:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552348:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921189 00000100:00100000:3.0:1705683932.552350:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:6521:x1788538641073472:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.552353:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.552438:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135917480/0xefc4487a018799ff lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9660:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b90 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.552446:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9660:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.552452:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.552452:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.552454:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135917480/0xefc4487a018799ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b90 expref: 4010 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.552518:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135917480/0xefc4487a018799ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b90 expref: 4010 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.552523:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135917480, rc 0) 00000100:00100000:0.0:1705683932.552534:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:7259:x1788538641073408:12345-192.168.203.41@tcp:101:dd.0 Request processed in 314us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.552537:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921188 00000100:00100000:1.0:1705683932.552573:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cf300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584536448:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.552585:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013207fc00/0xefc4487a01879a06 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b97 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552587:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b74 expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552594:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8ef80, rc 0) 00002000:00010000:3.0:1705683932.552594:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.552602:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.552602:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.552603:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.552607:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207fc00/0xefc4487a01879a06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b97 expref: 5973 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.552610:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5973:16415:x1788538641073088:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 979us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.552615:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921184 00010000:00010000:3.0:1705683932.552617:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013207fc00/0xefc4487a01879a06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b97 expref: 5973 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552622:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207fc00, rc 0) 00000100:00100000:3.0:1705683932.552632:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552633:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552636:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073536 00000100:00100000:1.0:1705683932.552639:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.552646:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4010 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.552648:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552648:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552651:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073600 00010000:00010000:0.0:1705683932.552659:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4011 pid: 15109 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.552659:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552660:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552664:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333163 00000100:00100000:3.0:1705683932.552668:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013766e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:1856:x1788538641073536:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.552669:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.552671:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552671:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552674:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073664 00010000:00010000:3.0:1705683932.552674:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.552676:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4011 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.552678:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.552679:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.552684:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4011 pid: 14216 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.552685:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333164 00000100:00100000:1.0:1705683932.552688:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:1856:x1788538641073600:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.552694:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.552696:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a2d00/0xefc4487a01824b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daf53 expref: 4011 pid: 14216 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.552701:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4011 pid: 15109 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.552719:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4010 pid: 15109 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.552720:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.552721:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.552724:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b74 expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552730:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b74 expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.552739:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3581 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.552739:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.552740:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.552742:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b7b expref: 4010 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552745:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097f8ef80/0xefc4487a018799e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b74 expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552747:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b7b expref: 4010 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.552748:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.552749:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552751:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584536704:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.552752:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333165 00000100:00100000:0.0:1705683932.552754:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:1857:x1788538641073664:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.552758:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.552759:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3581 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.552760:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b7b expref: 4010 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.552763:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3581 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.552766:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584536768:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.552771:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.552771:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.552773:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b82 expref: 3508 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.552774:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012e047240 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.552776:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b82 expref: 3508 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.552780:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.552785:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b82 expref: 3508 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.552789:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584536832:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.552795:0:15148:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d03480/0xefc4487a017fb869 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cce34 expref: 3581 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.552796:0:14216:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0ba080/0xefc4487a018637fa lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb32a expref: 4010 pid: 15109 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.552801:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.552805:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907aa800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584536512:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.552807:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584536576:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.552816:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013207cf00/0xefc4487a018799ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x952e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b7b expref: 4009 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.552818:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8f700/0xefc4487a018799f1 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6686:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b82 expref: 3508 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.552821:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207cf00, rc 0) 00010000:00010000:1.0:1705683932.552823:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8f700, rc 0) 00000100:00100000:3.0:1705683932.552832:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d336900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:6554:x1788538641073152:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1174us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.552835:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921185 00000100:00100000:1.0:1705683932.552837:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d333700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3508:16443:x1788538641073216:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 886us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.552842:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921186 00000100:00100000:3.0:1705683932.552849:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:6521:x1788538641073472:12345-192.168.203.41@tcp:101:dd.0 Request processed in 499us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.552852:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921189 00000100:00100000:1.0:1705683932.552877:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584536640:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.552884:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8e800, rc 0) 00000100:00100000:0.0:1705683932.552891:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.552895:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d330a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:4708:x1788538641072896:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1630us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.552897:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.552898:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921181 00000100:00100000:3.0:1705683932.552898:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552901:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073728 00000100:00100000:1.0:1705683932.552907:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.552908:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552909:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.552910:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.552911:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921190 00000100:00100000:1.0:1705683932.552915:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3581:6496:x1788538641073728:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.552920:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.553002:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8ed00/0xefc4487a01879a0d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301b9e expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.553011:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.553018:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.553019:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.553022:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8ed00/0xefc4487a01879a0d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b9e expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553028:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8ed00/0xefc4487a01879a0d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301b9e expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553033:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8ed00, rc 0) 00000100:00100000:1.0:1705683932.553044:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:6496:x1788538641073728:12345-192.168.203.41@tcp:101:dd.0 Request processed in 129us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.553048:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921190 00000100:00100000:0.0:1705683932.553139:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.553173:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553174:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553177:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073792 00000100:00100000:1.0:1705683932.553186:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553187:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553190:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921191 00000100:00100000:1.0:1705683932.553192:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:7259:x1788538641073792:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.553197:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.553279:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8e080/0xefc4487a01879a14 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x871f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ba5 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.553289:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x871f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.553296:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.553297:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.553300:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8e080/0xefc4487a01879a14 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ba5 expref: 3583 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553306:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8e080/0xefc4487a01879a14 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x871f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ba5 expref: 3583 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553316:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8e080, rc 0) 00000100:00100000:1.0:1705683932.553331:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:7259:x1788538641073792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 138us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.553336:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921191 00000100:00100000:1.0:1705683932.553519:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584536768:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.553527:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.553529:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584536704:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.553538:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.553541:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cf300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4007:1856:x1788538641073600:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 852us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.553544:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333164 00000100:00100000:3.0:1705683932.553550:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013766e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4006:1856:x1788538641073536:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 882us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.553554:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333163 00000100:00100000:0.0:1705683932.553620:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584536832:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.553627:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.553634:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.553637:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c9400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:1857:x1788538641073664:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 883us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.553641:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333165 00000100:00100000:1.0:1705683932.553672:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553673:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553677:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073856 00000100:00100000:1.0:1705683932.553688:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553689:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553692:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921192 00000100:00100000:1.0:1705683932.553694:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3508:16415:x1788538641073856:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.553699:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.553783:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.553792:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.553797:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bac expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.553799:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553800:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553805:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073920 00010000:00010000:1.0:1705683932.553809:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3582 pid: 14405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553813:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.553815:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1705683932.553815:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.553816:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bac expref: 3509 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.553816:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553817:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641073984 00000100:00100000:3.0:1705683932.553821:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553822:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.553825:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.553825:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921193 00000100:00100000:3.0:1705683932.553827:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:6554:x1788538641073920:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.553828:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3582 pid: 14405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.553831:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.553834:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3582 pid: 14405 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.553841:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584536896:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.553859:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.553867:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553868:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553872:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074048 00010000:00010000:3.0:1705683932.553876:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bb3 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.553884:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553884:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.553887:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921194 00010000:00010000:3.0:1705683932.553889:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3583 pid: 15107 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.553891:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5972:16443:x1788538641073984:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.553894:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.553896:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.553896:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.553897:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bb3 expref: 3583 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.553911:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3583 pid: 15107 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.553917:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3583 pid: 15107 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.553925:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584536960:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.553943:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.553951:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553951:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.553955:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921195 00000100:00100000:3.0:1705683932.553957:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:6521:x1788538641074048:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.553962:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.553982:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bba expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553993:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4005 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.553998:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.553998:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.554000:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bba expref: 5973 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554010:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4005 pid: 15123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554015:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4005 pid: 15123 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.554021:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537024:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.554034:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.554141:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.554157:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.554165:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554166:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554169:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074112 00000100:00100000:0.0:1705683932.554177:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554178:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554179:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074176 00000100:00100000:0.0:1705683932.554183:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554183:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554186:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921196 00000100:00100000:0.0:1705683932.554187:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4006:7259:x1788538641074112:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.554191:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584536896:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.554192:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.554202:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bac expref: 3510 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554209:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097f8f200, rc 0) 00010000:00010000:3.0:1705683932.554209:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207ca00/0xefc4487a01879a30 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bc1 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.554221:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.554224:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:16415:x1788538641073856:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 529us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.554229:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921192 00010000:00010000:3.0:1705683932.554230:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.554231:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.554234:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207ca00/0xefc4487a01879a30 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bc1 expref: 3511 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.554238:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554238:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554242:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921197 00010000:00010000:3.0:1705683932.554242:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207ca00/0xefc4487a01879a30 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bc1 expref: 3510 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.554245:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:4708:x1788538641074176:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.554249:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.554253:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207ca00, rc 0) 00000100:00100000:3.0:1705683932.554267:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:6521:x1788538641074048:12345-192.168.203.41@tcp:101:dd.0 Request processed in 308us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.554272:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921195 00010000:00010000:1.0:1705683932.554274:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bcf expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554284:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3509 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.554288:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.554289:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.554290:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bcf expref: 3585 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554301:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3509 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.554306:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3509 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.554312:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584537088:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.554327:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.554354:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.554368:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554369:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554387:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.554398:0:6519:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074240 00010000:00010000:0.0:1705683932.554406:0:6519:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3586 pid: 14405 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.554414:0:6519:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554415:0:6519:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554416:0:6519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333166 00000100:00100000:0.0:1705683932.554418:0:6519:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:1856:x1788538641074240:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.554421:0:6519:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.554422:0:6519:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3586 pid: 14405 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.554429:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3586 pid: 14405 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.554437:0:6519:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085efb480/0xefc4487a01824d9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2daff4 expref: 3586 pid: 14405 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.554442:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.554442:0:6519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.554442:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584536960:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.554444:0:6519:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bac expref: 3509 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.554447:0:6519:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bac expref: 3509 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.554453:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bb3 expref: 3585 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.554456:0:6519:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097f8f200/0xefc4487a01879a1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bac expref: 3509 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.554459:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207d180, rc 0) 00000100:00100000:0.0:1705683932.554460:0:6519:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584537152:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.554474:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8cee00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537024:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.554474:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:6554:x1788538641073920:12345-192.168.203.41@tcp:101:dd.0 Request processed in 647us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.554477:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921193 00010000:00010000:1.0:1705683932.554484:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bba expref: 5973 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554491:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ff480, rc 0) 00000100:00100000:0.0:1705683932.554510:0:6519:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.554512:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5973:16443:x1788538641073984:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 621us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.554516:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554516:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554519:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921194 00000100:00100000:0.0:1705683932.554520:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074304 00000100:00100000:1.0:1705683932.554526:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554527:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554529:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554530:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554530:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921198 00000100:00100000:1.0:1705683932.554532:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4007:6496:x1788538641074304:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.554535:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135914a00/0xefc4487a01879a3e lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9661:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bc8 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554537:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1705683932.554544:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9661:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.554549:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.554550:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.554552:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135914a00/0xefc4487a01879a3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bc8 expref: 4008 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.554556:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135914a00/0xefc4487a01879a3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bc8 expref: 4008 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.554560:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135914a00, rc 0) 00000100:00100000:0.0:1705683932.554568:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:7259:x1788538641074112:12345-192.168.203.41@tcp:101:dd.0 Request processed in 380us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.554571:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921196 00000100:00100000:0.0:1705683932.554586:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.554616:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.554634:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554635:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.554635:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554636:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.554639:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074368 00000100:00100000:1.0:1705683932.554640:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074432 00010000:00010000:3.0:1705683932.554645:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3585 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.554648:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4008 pid: 15123 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.554661:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.554661:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.554664:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554664:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.554664:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333167 00000100:00100000:0.0:1705683932.554665:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554665:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.554667:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:1856:x1788538641074368:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.554669:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333168 00000100:00100000:1.0:1705683932.554671:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:1857:x1788538641074432:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.554671:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.554676:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.554678:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4008 pid: 15123 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.554679:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3585 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.554684:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4008 pid: 15123 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.554690:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3585 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.554694:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013201c000/0xefc4487a017fc1bc lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cd645 expref: 4008 pid: 15123 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.554700:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.554701:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.554701:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013203af80/0xefc4487a018637d7 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb338 expref: 3585 pid: 15107 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.554703:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bba expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.554718:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.554719:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.554722:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bb3 expref: 3584 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.554727:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bb3 expref: 3584 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554741:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bba expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.554742:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013207d180/0xefc4487a01879a22 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bb3 expref: 3584 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.554749:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584537216:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.554756:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958ff480/0xefc4487a01879a29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bba expref: 5972 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.554763:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537280:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.554770:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.554778:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.554788:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958fd680/0xefc4487a01879a45 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9228:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bd6 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.554796:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9228:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.554802:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.554803:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.554805:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fd680/0xefc4487a01879a45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bd6 expref: 4008 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554811:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958fd680/0xefc4487a01879a45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bd6 expref: 4008 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554816:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fd680, rc 0) 00000100:00100000:1.0:1705683932.554829:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:6496:x1788538641074304:12345-192.168.203.41@tcp:101:dd.0 Request processed in 295us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.554833:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921198 00000100:00100000:1.0:1705683932.554893:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88011d8c9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584537088:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.554903:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bcf expref: 3584 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.554910:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fed00, rc 0) 00000100:00100000:1.0:1705683932.554924:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:4708:x1788538641074176:12345-192.168.203.41@tcp:101:dd.0 Request processed in 680us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.554928:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921197 00000100:00100000:0.0:1705683932.554980:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.554989:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554990:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.554994:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074496 00010000:00010000:1.0:1705683932.555002:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3510 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.555012:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.555012:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555013:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555016:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333169 00000100:00100000:1.0:1705683932.555019:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:1857:x1788538641074496:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.555024:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.555031:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3510 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.555035:0:6519:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6519:1788538584537152:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.555038:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3510 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.555042:0:6519:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.555048:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009983a800/0xefc4487a01847b81 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd8f expref: 3510 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.555051:0:6519:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d8cc600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:1856:x1788538641074240:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 632us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.555054:0:6519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333166 00010000:00010000:1.0:1705683932.555060:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.555060:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.555062:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bcf expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.555084:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bcf expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.555100:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958fed00/0xefc4487a01879a37 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bcf expref: 3582 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.555106:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584537344:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.555124:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.555132:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555133:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555137:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074560 00000100:00100000:1.0:1705683932.555148:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555148:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555151:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921199 00000100:00100000:1.0:1705683932.555153:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5973:6521:x1788538641074560:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.555158:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.555269:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537280:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.555270:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.555307:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907acb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584537216:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.555314:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.555316:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.555327:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4007:1857:x1788538641074432:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 655us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.555330:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333168 00000100:00100000:3.0:1705683932.555331:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e2800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3582:1856:x1788538641074368:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 662us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.555336:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333167 00000100:00100000:0.0:1705683932.555341:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.555341:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.555345:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074624 00000100:00100000:0.0:1705683932.555350:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.555351:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.555353:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921200 00000100:00100000:0.0:1705683932.555354:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907aa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5974:16415:x1788538641074624:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1705683932.555358:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.555385:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.555409:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555410:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555414:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074688 00000100:00100000:3.0:1705683932.555425:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555426:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555429:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921201 00000100:00100000:3.0:1705683932.555432:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907acb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:16443:x1788538641074688:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.555438:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.555512:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301be4 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.555514:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ff200/0xefc4487a01879a53 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x938f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bdd expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.555522:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4006 pid: 15106 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.555523:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x938f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.555525:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.555526:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.555527:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301be4 expref: 5976 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.555531:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.555532:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.555535:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4006 pid: 15106 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.555535:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ff200/0xefc4487a01879a53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bdd expref: 5976 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.555538:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4006 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.555541:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ff200/0xefc4487a01879a53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x938f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bdd expref: 5976 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.555545:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584537408:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.555546:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ff200, rc 0) 00000100:00100000:0.0:1705683932.555561:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.555562:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5976:6521:x1788538641074560:12345-192.168.203.41@tcp:101:dd.0 Request processed in 408us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.555566:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921199 00000100:00100000:0.0:1705683932.555574:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.555578:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555579:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555582:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074816 00010000:00010000:3.0:1705683932.555583:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301beb expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.555589:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.555589:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.555591:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.555592:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921202 00000100:00100000:1.0:1705683932.555594:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4007:6554:x1788538641074816:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.555594:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3581 pid: 15222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.555597:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.555598:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.555599:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.555599:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301beb expref: 3511 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.555608:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3581 pid: 15222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.555612:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3581 pid: 15222 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.555615:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bf9 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.555616:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584537472:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.555625:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.555629:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.555630:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.555631:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf9 expref: 4008 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.555631:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.555639:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555639:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555642:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074752 00000100:00100000:0.0:1705683932.555644:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.555648:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584537344:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.555651:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555652:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555654:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074880 00010000:00010000:1.0:1705683932.555656:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.555659:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555660:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555662:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921203 00000100:00100000:0.0:1705683932.555664:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555664:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e7300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:7259:x1788538641074752:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.555665:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.555668:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.555669:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921204 00000100:00100000:1.0:1705683932.555669:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3511:1857:x1788538641074496:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 650us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.555672:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:6496:x1788538641074880:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.555673:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333169 00010000:00010000:0.0:1705683932.555676:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.555691:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.555697:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.555704:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537536:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.555728:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.555816:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207f200/0xefc4487a01879a68 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301bf2 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.555824:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.555830:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.555831:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.555833:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207f200/0xefc4487a01879a68 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf2 expref: 3584 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.555838:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207f200/0xefc4487a01879a68 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf2 expref: 3584 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.555842:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207f200, rc 0) 00000100:00100000:3.0:1705683932.555857:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e7300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:7259:x1788538641074752:12345-192.168.203.41@tcp:101:dd.0 Request processed in 191us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.555861:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921203 00000100:00100000:3.0:1705683932.555899:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.555910:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555911:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555915:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641074944 00000100:00100000:3.0:1705683932.555922:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555923:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.555925:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921205 00000100:00100000:3.0:1705683932.555927:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907ac600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:4708:x1788538641074944:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.555931:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.555938:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135916580/0xefc4487a01879a6f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c00 expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.555945:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.555952:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.555952:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.555954:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135916580/0xefc4487a01879a6f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c00 expref: 3584 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.555959:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135916580/0xefc4487a01879a6f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c00 expref: 3584 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.555963:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135916580, rc 0) 00000100:00100000:0.0:1705683932.555973:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:6496:x1788538641074880:12345-192.168.203.41@tcp:101:dd.0 Request processed in 302us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.555978:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921204 00010000:00010000:3.0:1705683932.555998:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c07 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.556010:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.556016:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.556017:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.556018:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c07 expref: 4010 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.556032:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.556039:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.556046:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584537600:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.556064:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.556065:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584537408:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.556088:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301be4 expref: 5975 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.556095:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135914500, rc 0) 00000100:00100000:3.0:1705683932.556103:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584537472:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.556113:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907aa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5975:16415:x1788538641074624:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 757us (845us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.556115:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301beb expref: 3510 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.556116:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.556117:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921200 00000100:00100000:1.0:1705683932.556123:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556124:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556127:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.556127:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075072 00010000:00010000:3.0:1705683932.556127:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207de00, rc 0) 00000100:00100000:1.0:1705683932.556137:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556137:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556139:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075008 00000100:00100000:3.0:1705683932.556143:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907acb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3511:16443:x1788538641074688:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 709us (758us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.556145:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3584 pid: 15222 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.556148:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921201 00000100:00100000:1.0:1705683932.556155:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556155:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556157:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333170 00000100:00100000:1.0:1705683932.556160:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8801369ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:1856:x1788538641075008:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.556164:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.556165:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3584 pid: 15222 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.556169:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.556171:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3584 pid: 15222 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.556175:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556175:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556179:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075136 00010000:00010000:1.0:1705683932.556181:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c2ed00/0xefc4487a017fc7c0 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cda9e expref: 3584 pid: 15222 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.556185:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4011 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.556189:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.556190:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.556192:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556192:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.556192:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301beb expref: 3510 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.556194:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333171 00000100:00100000:0.0:1705683932.556196:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:1856:x1788538641075136:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.556197:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301beb expref: 3510 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556199:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.556200:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4011 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.556204:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4011 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.556211:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ab7700/0xefc4487a01824f39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db079 expref: 4011 pid: 15106 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.556212:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013207de00/0xefc4487a01879a5a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6687:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301beb expref: 3510 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556217:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.556217:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.556219:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301be4 expref: 5974 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.556219:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584537664:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.556223:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301be4 expref: 5974 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556231:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135914500/0xefc4487a01879a4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301be4 expref: 5974 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.556235:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537728:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.556237:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff8800a000ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.556246:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.556258:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556259:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556263:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921206 00000100:00100000:1.0:1705683932.556266:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3510:6521:x1788538641075072:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.556271:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.556461:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958fe300/0xefc4487a01879a7d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c0e expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.556471:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.556478:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.556479:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.556482:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958fe300/0xefc4487a01879a7d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c0e expref: 3511 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.556488:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958fe300/0xefc4487a01879a7d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c0e expref: 3511 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.556493:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fe300, rc 0) 00000100:00100000:1.0:1705683932.556517:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3511:6521:x1788538641075072:12345-192.168.203.41@tcp:101:dd.0 Request processed in 250us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.556524:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921206 00000100:00100000:0.0:1705683932.556614:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537536:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.556655:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584537600:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.556665:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c07 expref: 4010 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.556673:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207d680, rc 0) 00010000:00010000:0.0:1705683932.556686:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf9 expref: 4010 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556691:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fcc80, rc 0) 00000100:00100000:3.0:1705683932.556693:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907ac600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:4708:x1788538641074944:12345-192.168.203.41@tcp:101:dd.0 Request processed in 764us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.556698:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921205 00000100:00100000:0.0:1705683932.556703:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:6554:x1788538641074816:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1109us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.556707:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921202 00000100:00100000:1.0:1705683932.556738:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584537664:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.556746:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.556757:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537728:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.556757:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8801369ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:1856:x1788538641075008:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 596us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.556761:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333170 00010000:00010000:0.0:1705683932.556765:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.556775:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e6e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:1856:x1788538641075136:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 578us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.556776:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.556778:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333171 00000100:00100000:0.0:1705683932.556783:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556783:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556785:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075200 00000100:00100000:1.0:1705683932.556785:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556786:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.556790:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.556801:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556802:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556803:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333172 00000100:00100000:1.0:1705683932.556804:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.556805:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:1857:x1788538641075200:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.556805:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.556808:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.556814:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.556814:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.556818:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.556824:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b0b9680/0xefc4487a01863832 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x952f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb33f expref: 4008 pid: 14398 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.556829:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.556830:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.556831:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf9 expref: 4007 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556834:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf9 expref: 4007 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.556841:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958fcc80/0xefc4487a01879a61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x952f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301bf9 expref: 4007 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.556848:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537792:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.556851:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556853:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556856:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075264 00000100:00100000:0.0:1705683932.556862:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.556865:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.556875:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556876:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.556878:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333173 00000100:00100000:1.0:1705683932.556881:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a9900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5975:1857:x1788538641075264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.556886:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.556892:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.556898:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.556907:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a67980/0xefc4487a01847b8f lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd96 expref: 5975 pid: 15147 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.556915:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.556916:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.556918:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c07 expref: 4007 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.556923:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c07 expref: 4007 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.556937:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013207d680/0xefc4487a01879a76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c07 expref: 4007 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.556943:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584537856:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.556961:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.557012:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.557020:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.557024:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557025:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557028:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075328 00000100:00100000:3.0:1705683932.557029:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557030:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557033:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.557035:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075392 00000100:00100000:1.0:1705683932.557040:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557041:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557044:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075456 00000100:00100000:3.0:1705683932.557048:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557049:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557052:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557053:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557054:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921207 00000100:00100000:0.0:1705683932.557056:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557056:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557058:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921208 00000100:00100000:3.0:1705683932.557058:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3511:16415:x1788538641075328:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.557061:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921209 00000100:00100000:1.0:1705683932.557062:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e0500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5975:16443:x1788538641075392:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.557063:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e0a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:6496:x1788538641075456:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.557065:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.557084:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.557117:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.557167:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c1c expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557175:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c15 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557181:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4008 pid: 14219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557185:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.557186:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.557187:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c1c expref: 5976 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557189:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3582 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557194:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.557195:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.557196:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c15 expref: 3512 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557198:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4008 pid: 14219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557204:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4008 pid: 14219 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.557210:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537920:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.557210:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3582 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557217:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3582 pid: 14234 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.557225:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584537984:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.557228:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.557244:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.557254:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.557278:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557279:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557283:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075520 00000100:00100000:3.0:1705683932.557295:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557296:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557300:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921210 00000100:00100000:3.0:1705683932.557303:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5977:6521:x1788538641075520:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.557308:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135915b80/0xefc4487a01879a92 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c23 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557308:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1705683932.557315:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9229:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.557320:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557321:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557323:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135915b80/0xefc4487a01879a92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c23 expref: 4009 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.557329:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135915b80/0xefc4487a01879a92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c23 expref: 4009 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.557332:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135915b80, rc 0) 00000100:00100000:0.0:1705683932.557344:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584537792:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.557351:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.557363:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:1857:x1788538641075200:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 557us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.557363:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.557366:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333172 00000100:00100000:0.0:1705683932.557376:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e0a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:6496:x1788538641075456:12345-192.168.203.41@tcp:101:dd.0 Request processed in 312us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.557378:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921209 00000100:00100000:0.0:1705683932.557382:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557383:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557385:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075584 00000100:00100000:0.0:1705683932.557390:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557391:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557392:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921211 00000100:00100000:0.0:1705683932.557394:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3583:6554:x1788538641075584:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.557397:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.557411:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c31 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.557418:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3584 pid: 15113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.557422:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557422:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557423:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c31 expref: 3584 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.557425:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584537856:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.557430:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3584 pid: 15113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.557434:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3584 pid: 15113 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.557435:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.557438:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584538048:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.557446:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a9900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5977:1857:x1788538641075264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 564us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.557449:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.557451:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333173 00000100:00100000:0.0:1705683932.557474:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.557483:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557484:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557488:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075648 00000100:00100000:1.0:1705683932.557497:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557498:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557501:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557501:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921212 00000100:00100000:0.0:1705683932.557502:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557504:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:7259:x1788538641075648:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.557509:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.557555:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317e8280/0xefc4487a01879aa0 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c2a expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.557569:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.557578:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.557579:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.557582:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317e8280/0xefc4487a01879aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c2a expref: 5977 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557590:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317e8280/0xefc4487a01879aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c2a expref: 5977 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557596:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317e8280, rc 0) 00000100:00100000:3.0:1705683932.557612:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5977:6521:x1788538641075520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 308us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.557616:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921210 00010000:00010000:1.0:1705683932.557617:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958fc500/0xefc4487a01879aa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9662:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c38 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.557618:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.557624:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557625:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557625:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557626:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:1.0:1705683932.557626:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9662:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.557628:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075712 00010000:00010000:1.0:1705683932.557633:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.557634:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.557636:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fc500/0xefc4487a01879aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c38 expref: 4009 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.557639:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557640:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557643:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.557643:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921213 00000100:00100000:0.0:1705683932.557644:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.557644:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958fc500/0xefc4487a01879aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c38 expref: 4009 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.557646:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:4708:x1788538641075712:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.557649:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fc500, rc 0) 00010000:00010000:3.0:1705683932.557651:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.557664:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:7259:x1788538641075648:12345-192.168.203.41@tcp:101:dd.0 Request processed in 158us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.557668:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921212 00010000:00010000:3.0:1705683932.557704:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c3f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557728:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3512 pid: 15177 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.557734:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.557735:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.557736:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c3f expref: 3586 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.557745:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3512 pid: 15177 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.557749:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3512 pid: 15177 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.557754:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584538112:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.557770:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.557784:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584537984:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.557793:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c15 expref: 3512 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.557794:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584537920:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.557797:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013207e080, rc 0) 00010000:00010000:0.0:1705683932.557803:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c1c expref: 5976 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.557809:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fc000, rc 0) 00000100:00100000:3.0:1705683932.557810:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3512:16415:x1788538641075328:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 753us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.557814:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921207 00000100:00100000:1.0:1705683932.557817:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.557819:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e0500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5976:16443:x1788538641075392:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 757us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.557822:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921208 00000100:00100000:1.0:1705683932.557825:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557826:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557830:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075776 00010000:00010000:1.0:1705683932.557838:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4009 pid: 14219 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.557846:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.557857:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557858:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557860:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075840 00000100:00100000:0.0:1705683932.557861:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557861:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.557865:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333174 00000100:00100000:0.0:1705683932.557867:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:1857:x1788538641075776:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.557868:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3587 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.557871:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.557872:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4009 pid: 14219 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.557876:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.557877:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.557880:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4009 pid: 14219 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.557880:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333175 00000100:00100000:1.0:1705683932.557883:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:1856:x1788538641075840:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.557887:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315ca800/0xefc4487a017fc9b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdbcb expref: 4009 pid: 14219 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.557888:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.557890:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3587 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.557893:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557893:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.557894:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c1c expref: 5975 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557896:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3587 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.557898:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c1c expref: 5975 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.557906:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958fc000/0xefc4487a01879a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c1c expref: 5975 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557908:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a248f00/0xefc4487a018251d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db144 expref: 3587 pid: 14234 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.557909:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584538176:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.557915:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.557916:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.557918:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c15 expref: 3511 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.557919:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.557922:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c15 expref: 3511 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.557936:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013207e080/0xefc4487a01879a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c15 expref: 3511 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.557943:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584538240:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.557958:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.558411:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.558412:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e5a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584538048:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.558419:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.558426:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c31 expref: 3586 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558433:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffa300, rc 0) 00000100:00100000:3.0:1705683932.558440:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:15169:1788538584538112:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.558441:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558441:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.558451:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c3f expref: 3586 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.558453:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075904 00010000:00010000:1.0:1705683932.558462:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3587 pid: 15113 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.558462:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317ea580, rc 0) 00000100:00100000:0.0:1705683932.558470:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584538176:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.558472:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558473:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558476:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333176 00010000:00010000:0.0:1705683932.558478:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.558478:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:1856:x1788538641075904:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.558480:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:4708:x1788538641075712:12345-192.168.203.41@tcp:101:dd.0 Request processed in 833us (862us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.558483:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1705683932.558484:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921213 00000100:00100000:0.0:1705683932.558487:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:1857:x1788538641075776:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 620us (673us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.558490:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3586 pid: 15113 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.558490:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558491:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558492:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333174 00000100:00100000:3.0:1705683932.558494:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641075968 00010000:00010000:1.0:1705683932.558497:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3586 pid: 15113 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.558506:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558507:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.558508:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aea0a00/0xefc4487a01863847 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb354 expref: 3586 pid: 15113 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.558509:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921214 00000100:00100000:3.0:1705683932.558511:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3512:6521:x1788538641075968:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.558516:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.558517:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.558518:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.558520:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c31 expref: 3585 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558525:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c31 expref: 3585 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558537:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ffa300/0xefc4487a01879a99 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c31 expref: 3585 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.558542:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584538304:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.558548:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.558554:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.558555:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558555:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558558:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076032 00010000:00010000:0.0:1705683932.558564:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3513 pid: 15177 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.558566:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:6554:x1788538641075584:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1171us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.558571:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921211 00000100:00100000:0.0:1705683932.558605:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558606:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558608:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558608:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558612:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333177 00000100:00100000:1.0:1705683932.558614:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3513:1857:x1788538641076032:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.558619:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.558624:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3513 pid: 15177 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.558630:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3513 pid: 15177 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.558639:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134f22d00/0xefc4487a01847b9d lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecd9d expref: 3513 pid: 15177 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.558646:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.558647:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.558649:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c3f expref: 3584 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558653:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c3f expref: 3584 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.558663:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.558664:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801317ea580/0xefc4487a01879aae lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c3f expref: 3584 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.558669:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584538368:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.558673:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.558680:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.558692:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584538240:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.558695:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317e9900/0xefc4487a01879ab5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c46 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558699:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.558701:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00002000:00010000:3.0:1705683932.558704:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.558718:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e1900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:1856:x1788538641075840:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 823us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.558722:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333175 00000100:00100000:3.0:1705683932.558728:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558729:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558732:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076096 00000100:00100000:1.0:1705683932.558733:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558734:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558737:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076160 00000100:00100000:0.0:1705683932.558742:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.558742:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558743:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558747:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558748:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558750:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076224 00000100:00100000:3.0:1705683932.558750:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076288 00000100:00100000:1.0:1705683932.558757:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558757:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558759:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.558760:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558761:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921215 00000100:00100000:1.0:1705683932.558764:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3514:16443:x1788538641076096:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1705683932.558765:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921216 00000100:00100000:3.0:1705683932.558768:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5976:16415:x1788538641076160:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1705683932.558769:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558769:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.558770:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.558772:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.558774:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921217 00000100:00100000:0.0:1705683932.558776:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:6496:x1788538641076224:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.558781:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.558842:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c4d expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558853:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3585 pid: 15100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558857:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.558858:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.558860:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c4d expref: 3515 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.558864:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c54 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.558867:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ff8a00/0xefc4487a01879aca lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c5b expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558871:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3585 pid: 15100 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.558874:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.558874:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4007 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.558876:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3586 pid: 15100 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.558878:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.558878:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.558880:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.558880:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.558880:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c54 expref: 5977 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.558882:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff8a00/0xefc4487a01879aca lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c5b expref: 3586 pid: 15215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.558883:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584538432:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.558887:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ff8a00/0xefc4487a01879aca lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c5b expref: 3586 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.558889:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4007 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.558891:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff8a00, rc 0) 00010000:00010000:3.0:1705683932.558893:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4007 pid: 15148 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.558899:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.558899:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584538496:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.558901:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:6496:x1788538641076224:12345-192.168.203.41@tcp:101:dd.0 Request processed in 124us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.558903:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921217 00000100:00100000:1.0:1705683932.558906:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558907:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558909:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.558910:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.558912:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921218 00000100:00100000:3.0:1705683932.558913:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.558915:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:7259:x1788538641076288:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.558921:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.558965:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.558966:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.558968:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317e9900/0xefc4487a01879ab5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c46 expref: 3515 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.558974:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317e9900/0xefc4487a01879ab5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c46 expref: 3515 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.558978:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317e9900, rc 0) 00000100:00100000:3.0:1705683932.558990:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e4100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3515:6521:x1788538641075968:12345-192.168.203.41@tcp:101:dd.0 Request processed in 478us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.558994:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921214 00010000:00010000:1.0:1705683932.558998:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140e080/0xefc4487a01879ad1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c62 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.559007:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.559015:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559016:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559019:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140e080/0xefc4487a01879ad1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c62 expref: 3586 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559026:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140e080/0xefc4487a01879ad1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c62 expref: 3586 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559031:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140e080, rc 0) 00000100:00100000:1.0:1705683932.559046:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:7259:x1788538641076288:12345-192.168.203.41@tcp:101:dd.0 Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.559051:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921218 00000100:00100000:0.0:1705683932.559444:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.559456:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584538368:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.559457:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.559463:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.559466:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.559483:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3514:1857:x1788538641076032:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 868us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.559488:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.559488:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333177 00000100:00100000:0.0:1705683932.559493:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559494:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559497:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076416 00000100:00100000:1.0:1705683932.559497:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559498:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559500:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076544 00010000:00010000:0.0:1705683932.559504:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3586 pid: 15100 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.559508:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4008 pid: 15148 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.559510:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559511:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559513:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333178 00000100:00100000:0.0:1705683932.559515:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:1857:x1788538641076416:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.559518:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.559519:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559519:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559519:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584538496:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.559520:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3586 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.559523:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333179 00010000:00010000:0.0:1705683932.559524:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3586 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.559525:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e3700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4008:1857:x1788538641076544:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.559530:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c54 expref: 5977 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559531:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.559533:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4008 pid: 15148 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.559534:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.559534:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.559536:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c4d expref: 3513 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.559538:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317eb700, rc 0) 00010000:00010000:0.0:1705683932.559539:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c4d expref: 3513 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559539:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4008 pid: 15148 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.559547:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c4d expref: 3513 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559551:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315c6f80/0xefc4487a01825433 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db1fa expref: 4008 pid: 15148 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.559552:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584538560:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.559552:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5977:16415:x1788538641076160:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 783us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.559555:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921216 00010000:00010000:1.0:1705683932.559559:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559559:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559562:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c54 expref: 5976 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.559563:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559564:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.559564:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.559567:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c54 expref: 5976 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.559567:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076352 00000100:00100000:3.0:1705683932.559578:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.559579:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317eb700/0xefc4487a01879ac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c54 expref: 5976 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.559579:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559581:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076480 00000100:00100000:1.0:1705683932.559585:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584538624:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.559588:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559589:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559592:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921219 00000100:00100000:3.0:1705683932.559595:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4009:6554:x1788538641076352:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.559600:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.559602:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.559617:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584538304:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.559623:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c69 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559625:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.559635:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:1856:x1788538641075904:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1156us (1215us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.559636:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4010 pid: 9017 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.559640:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333176 00010000:00010000:3.0:1705683932.559642:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.559644:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.559646:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c69 expref: 4010 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.559656:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.559658:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4010 pid: 9017 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.559664:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4010 pid: 9017 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.559669:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559670:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559670:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584538688:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.559673:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076608 00000100:00100000:1.0:1705683932.559684:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559684:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559687:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.559688:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921220 00000100:00100000:1.0:1705683932.559690:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:4708:x1788538641076480:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.559693:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.559696:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.559697:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559699:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559704:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076672 00000100:00100000:3.0:1705683932.559725:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559726:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559727:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559728:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.559729:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921221 00000100:00100000:3.0:1705683932.559733:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:6496:x1788538641076608:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.559735:0:15215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921222 00000100:00100000:0.0:1705683932.559737:0:15215:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5977:6521:x1788538641076672:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.559739:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.559742:0:15215:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.559748:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c70 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559760:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5977 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.559764:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559765:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.559767:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c70 expref: 4012 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559783:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5977 pid: 15225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.559789:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5977 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.559796:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584538752:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.559815:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.559829:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a70f00/0xefc4487a017fcb32 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc0a expref: 3585 pid: 15100 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.559838:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584538432:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.559848:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958fc280/0xefc4487a01879abc lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6688:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c4d expref: 3513 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.559853:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958fc280, rc 0) 00000100:00100000:1.0:1705683932.559865:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3513:16443:x1788538641076096:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1101us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.559869:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921215 00010000:00010000:0.0:1705683932.559877:0:15215:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ff8780/0xefc4487a01879ae6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c7e expref: -99 pid: 15215 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.559884:0:15215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.559935:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.559936:0:15215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.559939:0:15215:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ff8780/0xefc4487a01879ae6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c7e expref: 5978 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.559944:0:15215:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ff8780/0xefc4487a01879ae6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c7e expref: 5978 pid: 15215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.559947:0:15215:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff8780, rc 0) 00000100:00100000:0.0:1705683932.559957:0:15215:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5978:6521:x1788538641076672:12345-192.168.203.41@tcp:101:dd.0 Request processed in 220us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.559959:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.559960:0:15215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921222 00000100:00100000:0.0:1705683932.559966:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559966:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.559968:0:15215:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076736 00000100:00100000:0.0:1705683932.559975:0:15215:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.559975:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317e9680/0xefc4487a01879aed lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c77 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.559984:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.559990:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.559992:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.559994:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317e9680/0xefc4487a01879aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c77 expref: 4014 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.559995:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.559996:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560002:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921223 00010000:00010000:3.0:1705683932.560002:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317e9680/0xefc4487a01879aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c77 expref: 4014 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560005:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:7259:x1788538641076736:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.560006:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317e9680, rc 0) 00000100:00100000:0.0:1705683932.560012:0:15215:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.560012:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.560019:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:6496:x1788538641076608:12345-192.168.203.41@tcp:101:dd.0 Request processed in 286us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.560022:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921221 00000100:00100000:0.0:1705683932.560045:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584538560:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.560052:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.560065:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3584:1857:x1788538641076416:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 549us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.560068:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333178 00000100:00100000:0.0:1705683932.560159:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090419400 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584538624:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.560160:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584538688:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.560165:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.560170:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c69 expref: 4013 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.560175:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317ea800, rc 0) 00000100:00100000:0.0:1705683932.560177:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e3700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:1857:x1788538641076544:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 652us (690us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.560177:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013140cf00/0xefc4487a01879af4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9663:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c85 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.560180:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333179 00000100:00100000:3.0:1705683932.560185:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e5a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:6554:x1788538641076352:12345-192.168.203.41@tcp:101:dd.0 Request processed in 590us (742us total) trans 0 rc 0/0 00002000:00010000:1.0:1705683932.560187:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9663:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.560188:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921219 00010000:00010000:1.0:1705683932.560195:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560196:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560199:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140cf00/0xefc4487a01879af4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c85 expref: 4012 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560206:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013140cf00/0xefc4487a01879af4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c85 expref: 4012 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560212:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140cf00, rc 0) 00000100:00100000:1.0:1705683932.560227:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:7259:x1788538641076736:12345-192.168.203.41@tcp:101:dd.0 Request processed in 221us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.560231:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921223 00000100:00100000:0.0:1705683932.560258:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.560268:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560268:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560273:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.560273:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076800 00010000:00010000:1.0:1705683932.560281:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4012 pid: 9017 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.560292:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560292:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560295:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333180 00000100:00100000:1.0:1705683932.560298:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:1856:x1788538641076800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.560303:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.560310:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4012 pid: 9017 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.560316:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4012 pid: 9017 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.560326:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c30c80/0xefc4487a018638b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb369 expref: 4012 pid: 9017 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.560333:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560334:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560336:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c69 expref: 4011 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560341:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c69 expref: 4011 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.560346:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560348:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.560354:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317ea800/0xefc4487a01879ad8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c69 expref: 4011 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560361:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584538816:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.560380:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.560391:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.560394:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584538752:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.560400:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560401:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560404:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076928 00010000:00010000:1.0:1705683932.560404:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c70 expref: 4011 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560411:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140e800, rc 0) 00010000:00010000:0.0:1705683932.560412:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5978 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.560421:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:4708:x1788538641076480:12345-192.168.203.41@tcp:101:dd.0 Request processed in 730us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.560423:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560424:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560424:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921220 00000100:00100000:0.0:1705683932.560427:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333181 00000100:00100000:0.0:1705683932.560430:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5978:1856:x1788538641076928:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.560431:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560432:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.560434:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.560434:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076864 00010000:00010000:0.0:1705683932.560441:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5978 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.560442:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560442:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560445:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921224 00010000:00010000:0.0:1705683932.560446:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5978 pid: 15225 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.560447:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3513:16415:x1788538641076864:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.560451:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.560502:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009983b980/0xefc4487a01847b96 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecda4 expref: 5978 pid: 15225 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.560510:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.560511:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.560512:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c70 expref: 4010 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560543:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c8c expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.560547:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c70 expref: 4010 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560554:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3583 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560558:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.560559:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.560560:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c8c expref: 3514 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.560561:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013140e800/0xefc4487a01879adf lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c70 expref: 4010 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.560565:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584538880:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.560570:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3583 pid: 14282 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560574:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3583 pid: 14282 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.560576:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.560580:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584538944:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.560593:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.560599:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.560603:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560604:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560606:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641076992 00000100:00100000:1.0:1705683932.560622:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560623:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560626:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921225 00000100:00100000:1.0:1705683932.560629:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3515:6521:x1788538641076992:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.560634:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.560635:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.560644:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.560645:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.560649:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077056 00000100:00100000:3.0:1705683932.560657:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.560658:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.560660:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921226 00000100:00100000:3.0:1705683932.560662:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5978:16443:x1788538641077056:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.560667:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.560780:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.560798:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140c500/0xefc4487a01879b02 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c93 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.560807:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.560814:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560815:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.560817:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140c500/0xefc4487a01879b02 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c93 expref: 3516 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560824:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140c500/0xefc4487a01879b02 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c93 expref: 3516 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.560829:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140c500, rc 0) 00010000:00010000:3.0:1705683932.560831:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301c9a expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560845:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3516:6521:x1788538641076992:12345-192.168.203.41@tcp:101:dd.0 Request processed in 215us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.560848:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4010 pid: 15227 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560850:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921225 00010000:00010000:3.0:1705683932.560852:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.560853:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.560855:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c9a expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560859:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560860:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560863:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077120 00000100:00100000:0.0:1705683932.560866:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.560867:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4010 pid: 15227 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.560872:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560873:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.560873:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4010 pid: 15227 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.560874:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077184 00000100:00100000:1.0:1705683932.560879:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560879:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.560880:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584539008:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.560882:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921227 00000100:00100000:0.0:1705683932.560884:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.560884:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.560884:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:6496:x1788538641077120:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.560888:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921228 00010000:00010000:1.0:1705683932.560889:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.560890:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3585:7259:x1788538641077184:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.560895:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.560898:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.561038:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140de00/0xefc4487a01879b10 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ca1 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.561047:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.561054:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.561055:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.561057:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140de00/0xefc4487a01879b10 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ca1 expref: 3586 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.561063:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140de00/0xefc4487a01879b10 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ca1 expref: 3586 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.561068:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140de00, rc 0) 00000100:00100000:1.0:1705683932.561100:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:6496:x1788538641077120:12345-192.168.203.41@tcp:101:dd.0 Request processed in 215us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.561104:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921227 00010000:00010000:0.0:1705683932.561139:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ff8500/0xefc4487a01879b17 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ca8 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.561146:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.561152:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561153:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561155:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff8500/0xefc4487a01879b17 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ca8 expref: 3586 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561160:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ff8500/0xefc4487a01879b17 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ca8 expref: 3586 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561166:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff8500, rc 0) 00000100:00100000:0.0:1705683932.561177:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:7259:x1788538641077184:12345-192.168.203.41@tcp:101:dd.0 Request processed in 286us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.561179:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584538816:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.561180:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921228 00010000:00010000:1.0:1705683932.561188:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.561200:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4010:1856:x1788538641076800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 900us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.561204:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333180 00000100:00100000:0.0:1705683932.561207:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e7300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584538880:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.561214:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.561220:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5979:1856:x1788538641076928:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 790us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.561223:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333181 00000100:00100000:1.0:1705683932.561237:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584538944:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.561246:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c8c expref: 3515 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.561252:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140d180, rc 0) 00000100:00100000:1.0:1705683932.561266:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3515:16415:x1788538641076864:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 818us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.561270:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921224 00000100:00100000:1.0:1705683932.561293:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.561302:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561303:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561306:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077248 00000100:00100000:0.0:1705683932.561313:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561313:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561315:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921229 00000100:00100000:0.0:1705683932.561317:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3586:6554:x1788538641077248:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.561321:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.561421:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301caf expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561430:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3587 pid: 15218 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.561438:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.561448:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561449:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561452:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077376 00000100:00100000:1.0:1705683932.561461:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561462:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561465:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921230 00000100:00100000:1.0:1705683932.561468:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3588:4708:x1788538641077376:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.561473:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561473:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.561473:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.561475:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301caf expref: 3588 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561484:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3588 pid: 15218 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.561489:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3588 pid: 15218 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.561493:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584539072:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.561502:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cb6 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.561505:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.561513:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3514 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.561517:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.561518:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.561518:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.561520:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cb6 expref: 3589 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.561523:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561524:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561526:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077312 00010000:00010000:0.0:1705683932.561532:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3590 pid: 14282 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.561535:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3514 pid: 15223 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.561538:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561539:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561541:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333182 00010000:00010000:1.0:1705683932.561541:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3514 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.561542:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:1857:x1788538641077312:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.561545:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.561546:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3590 pid: 14282 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.561547:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584539136:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.561550:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3590 pid: 14282 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.561560:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba50500/0xefc4487a0182567f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db28d expref: 3590 pid: 14282 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.561563:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.561566:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561567:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561568:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c8c expref: 3514 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561571:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c8c expref: 3514 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561579:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013140d180/0xefc4487a01879afb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c8c expref: 3514 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.561583:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e3200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539200:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.561592:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.561612:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584539008:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.561623:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c9a expref: 5978 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.561624:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.561629:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317ea300, rc 0) 00000100:00100000:1.0:1705683932.561633:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561634:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561638:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077440 00000100:00100000:3.0:1705683932.561640:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5979:16443:x1788538641077056:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 977us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.561644:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921226 00000100:00100000:1.0:1705683932.561652:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561652:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561653:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561653:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561656:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921231 00000100:00100000:3.0:1705683932.561658:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5978:6521:x1788538641077440:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.561663:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.561829:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.561836:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.561840:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561840:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561841:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561841:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561844:0:15209:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077504 00000100:00100000:1.0:1705683932.561845:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077568 00010000:00010000:0.0:1705683932.561850:0:15209:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4011 pid: 15227 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.561856:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561856:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.561856:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317e9400/0xefc4487a01879b2c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cbd expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.561857:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.561857:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.561858:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333183 00000100:00100000:1.0:1705683932.561860:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921232 00000100:00100000:0.0:1705683932.561861:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:1856:x1788538641077504:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.561863:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:6496:x1788538641077568:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.561864:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1705683932.561865:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.561866:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4011 pid: 15227 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.561868:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.561869:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4011 pid: 15227 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.561871:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.561872:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.561874:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317e9400/0xefc4487a01879b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cbd expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561876:0:15209:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099aba080/0xefc4487a017fccb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdc65 expref: 4011 pid: 15227 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.561879:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317e9400/0xefc4487a01879b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cbd expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561881:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561882:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.561883:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c9a expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.561883:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317e9400, rc 0) 00010000:00010000:0.0:1705683932.561887:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c9a expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.561896:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317ea300/0xefc4487a01879b09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x7349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301c9a expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.561898:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5979:6521:x1788538641077440:12345-192.168.203.41@tcp:101:dd.0 Request processed in 239us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.561900:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584539264:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.561901:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921231 00000100:00100000:0.0:1705683932.561911:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.561948:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.561967:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561968:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561972:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077632 00000100:00100000:3.0:1705683932.561981:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561981:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.561984:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921233 00000100:00100000:3.0:1705683932.561986:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:7259:x1788538641077632:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.561989:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.562006:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013140c000/0xefc4487a01879b33 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cc4 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.562015:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.562022:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562023:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562026:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140c000/0xefc4487a01879b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cc4 expref: 4012 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562032:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013140c000/0xefc4487a01879b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cc4 expref: 4012 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562037:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140c000, rc 0) 00000100:00100000:1.0:1705683932.562053:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:6496:x1788538641077568:12345-192.168.203.41@tcp:101:dd.0 Request processed in 189us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.562057:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921232 00010000:00010000:3.0:1705683932.562132:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317e9b80/0xefc4487a01879b3a lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9664:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ccb expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.562140:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9664:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.562146:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.562147:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.562149:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317e9b80/0xefc4487a01879b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ccb expref: 4012 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.562154:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317e9b80/0xefc4487a01879b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ccb expref: 4012 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.562157:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317e9b80, rc 0) 00000100:00100000:0.0:1705683932.562161:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e3200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539200:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.562164:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584539136:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.562168:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.562172:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:7259:x1788538641077632:12345-192.168.203.41@tcp:101:dd.0 Request processed in 185us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.562175:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921233 00010000:00010000:1.0:1705683932.562176:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cb6 expref: 3589 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.562178:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3589:1857:x1788538641077312:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 635us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.562181:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333182 00010000:00010000:1.0:1705683932.562184:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140c780, rc 0) 00000100:00100000:1.0:1705683932.562198:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3588:4708:x1788538641077376:12345-192.168.203.41@tcp:101:dd.0 Request processed in 729us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.562199:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.562202:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921230 00000100:00100000:0.0:1705683932.562204:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562204:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562207:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077760 00010000:00010000:0.0:1705683932.562211:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3515 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.562217:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562217:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562219:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333184 00000100:00100000:1.0:1705683932.562220:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e7300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0000_UUID:15110:1788538584539072:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.562221:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4151850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3515:1856:x1788538641077760:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.562224:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.562229:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3515 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.562230:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301caf expref: 3587 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.562232:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3515 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.562237:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffb980, rc 0) 00010000:00010000:0.0:1705683932.562239:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136323480/0xefc4487a01847bab lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdab expref: 3515 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.562243:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.562244:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.562245:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cb6 expref: 3587 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.562248:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:6554:x1788538641077248:12345-192.168.203.41@tcp:101:dd.0 Request processed in 929us (955us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.562249:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cb6 expref: 3587 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.562255:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921229 00010000:00010000:0.0:1705683932.562257:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013140c780/0xefc4487a01879b25 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cb6 expref: 3587 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.562260:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073487800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539328:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.562270:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.562372:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.562387:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562388:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562392:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e4100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:15209:1788538584539264:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.562393:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077696 00010000:00010000:0.0:1705683932.562398:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1705683932.562401:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3587 pid: 15218 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.562405:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6400 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:1856:x1788538641077504:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 544us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.562408:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333183 00000100:00100000:1.0:1705683932.562412:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562413:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562414:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.562414:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562416:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333185 00000100:00100000:1.0:1705683932.562419:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073484100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:1856:x1788538641077696:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.562423:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.562427:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.562430:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3587 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.562436:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3587 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.562446:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14bd680/0xefc4487a018638be lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb377 expref: 3587 pid: 15218 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.562452:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562453:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562454:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301caf expref: 3586 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.562457:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.562459:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301caf expref: 3586 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562470:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ffb980/0xefc4487a01879b1e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301caf expref: 3586 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.562476:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584539392:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.562489:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.562497:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562497:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562500:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077824 00000100:00100000:0.0:1705683932.562507:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.562516:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562517:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562518:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077888 00000100:00100000:1.0:1705683932.562524:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562525:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562525:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562526:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562527:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641077952 00000100:00100000:3.0:1705683932.562531:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921234 00000100:00100000:3.0:1705683932.562534:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073480a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5979:16415:x1788538641077824:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.562535:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562536:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.562539:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.562540:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921235 00000100:00100000:1.0:1705683932.562543:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073486400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3516:6521:x1788538641077888:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.562547:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.562744:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140d400/0xefc4487a01879b41 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cd9 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.562753:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.562760:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562762:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.562764:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140d400/0xefc4487a01879b41 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd9 expref: 3517 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562771:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140d400/0xefc4487a01879b41 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd9 expref: 3517 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562776:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140d400, rc 0) 00000100:00100000:1.0:1705683932.562793:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073486400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3517:6521:x1788538641077888:12345-192.168.203.41@tcp:101:dd.0 Request processed in 250us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.562797:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921235 00000100:00100000:1.0:1705683932.562805:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562805:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.562808:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921236 00000100:00100000:1.0:1705683932.562811:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3516:16443:x1788538641077952:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.562811:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cd2 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562815:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.562822:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4010 pid: 14223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.562826:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.562827:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.562828:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd2 expref: 5980 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.562838:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4010 pid: 14223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.562842:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4010 pid: 14223 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.562847:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584539456:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.562852:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.562862:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.562870:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562871:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562874:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078016 00000100:00100000:3.0:1705683932.562883:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562884:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.562886:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921237 00000100:00100000:3.0:1705683932.562888:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073484600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:6496:x1788538641078016:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.562891:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.562905:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.562933:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 2/0,0 mode: --/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ce0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562944:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3587 pid: 15167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562949:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.562949:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.562951:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 4/0,0 mode: --/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce0 expref: 3517 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562962:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3587 pid: 15167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.562967:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3587 pid: 15167 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.562978:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584539520:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.562993:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.563000:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563001:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563005:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078080 00000100:00100000:1.0:1705683932.563015:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563015:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563019:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921238 00000100:00100000:1.0:1705683932.563021:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073481900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3588:7259:x1788538641078080:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.563026:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.563143:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073487800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539328:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.563152:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.563164:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4151850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3517:1856:x1788538641077760:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 942us (964us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.563200:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801317eb200/0xefc4487a01879b56 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ce7 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.563208:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.563215:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563216:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563218:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801317eb200/0xefc4487a01879b56 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce7 expref: 3589 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.563225:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801317eb200/0xefc4487a01879b56 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce7 expref: 3589 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.563229:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333184 00010000:00010000:3.0:1705683932.563229:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317eb200, rc 0) 00000100:00100000:3.0:1705683932.563241:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073484600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3589:6496:x1788538641078016:12345-192.168.203.41@tcp:101:dd.0 Request processed in 352us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.563244:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921237 00010000:00010000:1.0:1705683932.563274:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140ed00/0xefc4487a01879b5d lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cee expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.563283:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.563303:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584539392:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.563307:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.563312:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.563325:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073484100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3589:1856:x1788538641077696:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 905us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.563329:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333185 00000100:00100000:3.0:1705683932.563333:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563333:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563338:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078144 00010000:00010000:1.0:1705683932.563341:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563342:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563344:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140ed00/0xefc4487a01879b5d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cee expref: 3588 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.563347:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563347:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563350:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921239 00010000:00010000:1.0:1705683932.563351:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140ed00/0xefc4487a01879b5d lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cee expref: 3588 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.563352:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4011:6554:x1788538641078144:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.563356:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.563360:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140ed00, rc 0) 00010000:00010000:3.0:1705683932.563371:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cf5 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.563372:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073481900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3588:7259:x1788538641078080:12345-192.168.203.41@tcp:101:dd.0 Request processed in 350us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.563376:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921238 00010000:00010000:3.0:1705683932.563380:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4012 pid: 15216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.563384:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563384:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563385:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cf5 expref: 4012 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.563394:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4012 pid: 15216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.563399:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4012 pid: 15216 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.563403:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584539584:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.563429:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.563440:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.563446:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584539456:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.563453:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563454:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563458:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078208 00010000:00010000:3.0:1705683932.563458:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd2 expref: 5980 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.563465:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.563466:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317ebc00, rc 0) 00000100:00100000:1.0:1705683932.563470:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563470:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563475:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921240 00000100:00100000:1.0:1705683932.563478:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:4708:x1788538641078208:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.563482:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073480a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5980:16415:x1788538641077824:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 947us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.563484:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563485:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563487:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078272 00000100:00100000:3.0:1705683932.563487:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921234 00010000:00010000:1.0:1705683932.563495:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4014 pid: 14223 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.563511:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563512:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563516:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333186 00000100:00100000:1.0:1705683932.563518:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073482d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:1857:x1788538641078272:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.563523:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.563526:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4014 pid: 14223 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.563532:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4014 pid: 14223 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.563543:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aedc280/0xefc4487a01825911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db343 expref: 4014 pid: 14223 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.563544:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.563552:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563553:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563555:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd2 expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.563557:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563558:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.563559:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd2 expref: 5979 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.563563:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078336 00010000:00010000:1.0:1705683932.563573:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317ebc00/0xefc4487a01879b48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cd2 expref: 5980 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.563575:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.563576:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.563579:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584539648:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.563579:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921241 00000100:00100000:3.0:1705683932.563583:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073481e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5980:6521:x1788538641078336:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.563589:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.563596:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.563605:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.563660:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301cfc expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.563670:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5980 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.563674:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563675:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.563676:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cfc expref: 4014 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.563686:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5980 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.563692:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5980 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.563694:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af0000/0xefc4487a01879b72 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d03 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.563697:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584539712:192.168.203.41@tcp:104: 00002000:00010000:3.0:1705683932.563701:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.563721:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.563721:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563722:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.563724:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af0000/0xefc4487a01879b72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d03 expref: 5981 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.563729:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af0000/0xefc4487a01879b72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d03 expref: 5981 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.563734:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af0000, rc 0) 00000100:00100000:3.0:1705683932.563745:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073481e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:6521:x1788538641078336:12345-192.168.203.41@tcp:101:dd.0 Request processed in 163us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.563748:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921241 00000100:00100000:1.0:1705683932.563831:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584539520:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.563842:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 3/0,0 mode: --/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce0 expref: 3516 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.563849:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140f700, rc 0) 00000100:00100000:1.0:1705683932.563900:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3516:16443:x1788538641077952:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1088us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.563904:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921236 00000100:00100000:1.0:1705683932.563923:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.563983:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.563984:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.563988:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078400 00010000:00010000:0.0:1705683932.563998:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3588 pid: 15167 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.564015:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564016:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564018:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564019:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333187 00000100:00100000:1.0:1705683932.564019:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564022:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3588:1857:x1788538641078400:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.564025:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584539584:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.564027:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.564029:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3588 pid: 15167 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.564035:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3588 pid: 15167 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.564035:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cf5 expref: 4014 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.564040:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af2580, rc 0) 00000100:00100000:1.0:1705683932.564044:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041da00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584539648:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.564047:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094eadb80/0xefc4487a017fcde0 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdca4 expref: 3588 pid: 15167 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.564052:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:6554:x1788538641078144:12345-192.168.203.41@tcp:101:dd.0 Request processed in 700us (747us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.564053:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.564055:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.564055:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921239 00010000:00010000:0.0:1705683932.564056:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.564058:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce0 expref: 3515 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.564063:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce0 expref: 3515 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564067:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073482d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:1857:x1788538641078272:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 547us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.564089:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333186 00000100:00100000:3.0:1705683932.564091:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.564094:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013140f700/0xefc4487a01879b4f lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x6689:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ce0 expref: 3515 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.564100:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539776:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.564118:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.564168:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564169:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564173:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078464 00000100:00100000:3.0:1705683932.564185:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564185:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564188:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.564189:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921242 00000100:00100000:3.0:1705683932.564192:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:6496:x1788538641078464:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.564196:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.564196:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.564197:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564201:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078528 00010000:00010000:1.0:1705683932.564209:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4014 pid: 15216 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.564218:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564218:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564221:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333188 00000100:00100000:1.0:1705683932.564224:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:1856:x1788538641078528:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.564229:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.564236:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4014 pid: 15216 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.564241:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4014 pid: 15216 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.564251:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aea3980/0xefc4487a018638cc lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb37e expref: 4014 pid: 15216 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.564260:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.564261:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.564263:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cf5 expref: 4013 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.564268:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cf5 expref: 4013 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.564284:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098af2580/0xefc4487a01879b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9531:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cf5 expref: 4013 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564291:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090418500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584539840:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.564308:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.564346:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af1900/0xefc4487a01879b79 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d0a expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.564355:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.564360:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.564363:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.564364:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.564367:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af1900/0xefc4487a01879b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d0a expref: 4014 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564370:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.564373:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.564374:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af1900/0xefc4487a01879b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d0a expref: 4014 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.564375:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564375:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564376:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564379:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078656 00000100:00100000:1.0:1705683932.564379:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078720 00010000:00010000:3.0:1705683932.564380:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af1900, rc 0) 00010000:00010000:1.0:1705683932.564386:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5981 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.564399:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564399:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:6496:x1788538641078464:12345-192.168.203.41@tcp:101:dd.0 Request processed in 206us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.564400:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564402:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564403:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564403:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333189 00000100:00100000:1.0:1705683932.564405:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:1857:x1788538641078720:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1705683932.564405:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921242 00000100:00100000:0.0:1705683932.564408:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.564408:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.564410:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.564413:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921243 00000100:00100000:3.0:1705683932.564413:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564414:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.564415:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5981 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.564416:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:7259:x1788538641078656:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.564420:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5981 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.564422:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.564428:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.564429:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.564431:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cfc expref: 4014 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.564434:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.564436:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cfc expref: 4014 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.564445:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cfc expref: 4014 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564450:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041c100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584539904:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.564467:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.564481:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bce4c80/0xefc4487a01847bb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb2 expref: 5981 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.564489:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041f300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0001_UUID:15135:1788538584539712:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.564490:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.564499:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013140e580/0xefc4487a01879b6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301cfc expref: 4014 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.564505:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140e580, rc 0) 00000100:00100000:1.0:1705683932.564520:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:4708:x1788538641078208:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1041us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.564524:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921240 00000100:00100000:3.0:1705683932.564573:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564574:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564577:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078592 00000100:00100000:3.0:1705683932.564584:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564585:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564586:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078784 00000100:00100000:3.0:1705683932.564591:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564591:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564594:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921244 00000100:00100000:3.0:1705683932.564596:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3517:16415:x1788538641078592:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.564600:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.564653:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564654:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564659:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921245 00010000:00010000:3.0:1705683932.564661:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d11 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564662:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3517:6521:x1788538641078784:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.564670:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.564671:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3587 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.564676:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.564677:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.564679:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d11 expref: 3518 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.564693:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3587 pid: 15187 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.564699:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3587 pid: 15187 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.564718:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584539968:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.564737:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.564751:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584539776:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.564763:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.564778:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041d000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:1857:x1788538641078400:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 755us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.564782:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333187 00010000:00010000:0.0:1705683932.564799:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ffaf80/0xefc4487a01879b87 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9665:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d18 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.564802:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.564829:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.564836:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564836:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564839:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078848 00000100:00100000:3.0:1705683932.564846:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564847:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564848:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078912 00000100:00100000:3.0:1705683932.564852:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.564853:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564855:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090418500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584539840:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.564855:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921246 00000100:00100000:3.0:1705683932.564857:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907a9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3587:6554:x1788538641078848:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.564860:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1705683932.564865:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9665:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.564865:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.564873:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.564875:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.564877:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ffaf80/0xefc4487a01879b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d18 expref: 4014 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564878:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:1856:x1788538641078528:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 653us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.564882:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333188 00010000:00010000:0.0:1705683932.564885:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ffaf80/0xefc4487a01879b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d18 expref: 4014 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.564887:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d26 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.564890:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffaf80, rc 0) 00010000:00010000:3.0:1705683932.564895:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3588 pid: 15175 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.564896:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.564897:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.564898:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.564899:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.564900:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d26 expref: 3588 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.564902:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921247 00000100:00100000:0.0:1705683932.564904:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:7259:x1788538641078656:12345-192.168.203.41@tcp:101:dd.0 Request processed in 487us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.564905:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907af300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:16443:x1788538641078912:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.564908:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3588 pid: 15175 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.564909:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921243 00010000:00010000:1.0:1705683932.564911:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.564911:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3588 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.564915:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584540032:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.564927:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.565056:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041c100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584539904:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.565064:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.565091:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:1857:x1788538641078720:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 685us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.565095:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333189 00010000:00010000:1.0:1705683932.565109:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d2d expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565119:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4012 pid: 15142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565123:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.565124:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.565125:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d2d expref: 5981 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565138:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4012 pid: 15142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565144:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4012 pid: 15142 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.565150:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041c100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584540096:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.565151:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.565165:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.565167:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.565176:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140f480/0xefc4487a01879b9c lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d1f expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.565183:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.565189:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565190:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565192:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140f480/0xefc4487a01879b9c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d1f expref: 3519 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565197:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140f480/0xefc4487a01879b9c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d1f expref: 3519 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565202:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140f480, rc 0) 00000100:00100000:1.0:1705683932.565215:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3519:6521:x1788538641078784:12345-192.168.203.41@tcp:101:dd.0 Request processed in 553us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.565216:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584539968:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.565219:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921245 00010000:00010000:3.0:1705683932.565225:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d11 expref: 3518 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.565226:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565227:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565230:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641078976 00010000:00010000:3.0:1705683932.565231:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af0500, rc 0) 00000100:00100000:1.0:1705683932.565239:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565239:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565241:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3518:16415:x1788538641078592:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 644us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.565242:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079040 00000100:00100000:3.0:1705683932.565245:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921244 00000100:00100000:1.0:1705683932.565250:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565250:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565251:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565252:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565254:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921248 00000100:00100000:1.0:1705683932.565258:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907aa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:6496:x1788538641078976:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.565258:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921249 00000100:00100000:3.0:1705683932.565260:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907acb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:4708:x1788538641079040:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.565263:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.565264:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.565280:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.565384:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.565402:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565403:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565407:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079104 00010000:00010000:1.0:1705683932.565416:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3591 pid: 15187 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.565425:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565426:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565428:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079168 00010000:00010000:1.0:1705683932.565432:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3592 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.565439:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565439:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565442:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333190 00000100:00100000:1.0:1705683932.565444:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073485000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1856:x1788538641079104:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.565444:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d3b expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565449:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.565451:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3593 pid: 15187 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.565453:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3517 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.565455:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3593 pid: 15187 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.565456:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.565457:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.565458:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d3b expref: 3593 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.565465:0:15209:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.565465:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3517 pid: 15223 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.565466:0:15209:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.565467:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6029180/0xefc4487a01825b56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db400 expref: 3593 pid: 15187 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1705683932.565470:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3517 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.565471:0:15209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333191 00000100:00100000:0.0:1705683932.565473:0:15209:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d91050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1856:x1788538641079168:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.565474:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565475:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.565475:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584540160:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.565477:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d11 expref: 3517 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.565478:0:15209:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.565482:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d11 expref: 3517 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.565484:0:15209:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 5/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3592 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.565488:0:15209:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3592 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.565491:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.565496:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098af0500/0xefc4487a01879b80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d11 expref: 3517 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.565499:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.565500:0:15209:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.565502:0:15209:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d26 expref: 3592 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.565503:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090418500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584540224:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.565504:0:15133:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a14bcf00/0xefc4487a018638ef lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb385 expref: 3592 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.565506:0:15209:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d26 expref: 3592 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.565512:0:15133:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0000_UUID:15133:1788538584540032:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.565515:0:15209:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d26 expref: 3591 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.565520:0:15209:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073480f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584540288:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.565520:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098af0780/0xefc4487a01879b8e lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d26 expref: 3591 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.565521:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.565524:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af0780, rc 0) 00000100:00100000:0.0:1705683932.565531:0:15209:0:(client.c:2536:ptlrpc_set_wait()) set ffff88012da51180 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.565533:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907a9400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6554:x1788538641078848:12345-192.168.203.41@tcp:101:dd.0 Request processed in 676us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.565536:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921246 00000100:00100000:1.0:1705683932.565541:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041c100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584540096:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.565548:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.565551:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d2d expref: 5981 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.565554:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.565554:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.565557:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079232 00010000:00010000:1.0:1705683932.565558:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140ea80, rc 0) 00010000:00010000:0.0:1705683932.565563:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4013 pid: 15142 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.565569:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907af300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:16443:x1788538641078912:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 663us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.565575:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.565575:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565575:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921247 00000100:00100000:0.0:1705683932.565578:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333192 00000100:00100000:0.0:1705683932.565579:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073486900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4013:1856:x1788538641079232:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.565582:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.565584:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4013 pid: 15142 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.565588:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4013 pid: 15142 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.565591:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013140e300/0xefc4487a01879baa lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d34 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.565598:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.565604:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565604:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565606:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013140e300/0xefc4487a01879baa lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d34 expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565611:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013140e300/0xefc4487a01879baa lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d34 expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565616:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013140e300, rc 0) 00000100:00100000:1.0:1705683932.565623:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907aa800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6496:x1788538641078976:12345-192.168.203.41@tcp:101:dd.0 Request processed in 366us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.565626:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921248 00010000:00010000:0.0:1705683932.565633:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801317d5e00/0xefc4487a017fd056 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd0d expref: 4013 pid: 15142 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.565649:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.565650:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.565651:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d2d expref: 5980 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.565655:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d2d expref: 5980 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.565664:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013140ea80/0xefc4487a01879b95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d2d expref: 5980 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.565667:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073483c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540352:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.565678:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.565681:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.565693:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565694:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565697:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079296 00000100:00100000:1.0:1705683932.565706:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565707:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565722:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921250 00000100:00100000:1.0:1705683932.565725:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:7259:x1788538641079296:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.565730:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.565883:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ef480/0xefc4487a01879bb1 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d42 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.565892:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.565899:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565900:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.565903:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ef480/0xefc4487a01879bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d42 expref: 3592 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.565909:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.565909:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ef480/0xefc4487a01879bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d42 expref: 3592 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.565914:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ef480, rc 0) 00000100:00100000:1.0:1705683932.565930:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:7259:x1788538641079296:12345-192.168.203.41@tcp:101:dd.0 Request processed in 204us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.565930:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565931:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565935:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921250 00000100:00100000:3.0:1705683932.565935:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079360 00000100:00100000:1.0:1705683932.565944:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565944:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565945:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.565946:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.565947:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921251 00000100:00100000:3.0:1705683932.565950:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5981:6521:x1788538641079360:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.565954:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.566151:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090418500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584540224:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.566158:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.566169:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073485000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:1856:x1788538641079104:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 725us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.566172:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333190 00000100:00100000:0.0:1705683932.566185:0:15209:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073480f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:15209:1788538584540288:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.566191:0:15209:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.566259:0:15209:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d91050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:1856:x1788538641079168:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 784us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.566263:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.566264:0:15209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333191 00010000:00010000:3.0:1705683932.566273:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af1400/0xefc4487a01879bb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d49 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.566281:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.566288:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566288:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566291:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af1400/0xefc4487a01879bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d49 expref: 5982 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.566296:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073483c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540352:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.566296:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af1400/0xefc4487a01879bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d49 expref: 5982 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.566300:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af1400, rc 0) 00010000:00010000:0.0:1705683932.566304:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1705683932.566312:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5982:6521:x1788538641079360:12345-192.168.203.41@tcp:101:dd.0 Request processed in 361us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.566315:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921251 00000100:00100000:0.0:1705683932.566318:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073486900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:1856:x1788538641079232:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 737us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.566318:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.566321:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566321:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566323:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333192 00000100:00100000:3.0:1705683932.566323:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079488 00000100:00100000:0.0:1705683932.566330:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566331:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566331:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566331:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566333:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921252 00000100:00100000:0.0:1705683932.566334:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079424 00000100:00100000:3.0:1705683932.566335:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4012:6554:x1788538641079488:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.566338:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.566342:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3518 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.566352:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.566352:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d50 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.566353:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566356:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333193 00000100:00100000:0.0:1705683932.566359:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3518:1856:x1788538641079424:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1705683932.566360:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4013 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.566363:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.566363:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566363:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566365:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d50 expref: 4013 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.566371:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3518 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.566374:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4013 pid: 15175 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1705683932.566377:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3518 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.566378:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4013 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.566383:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584540416:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.566392:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.566393:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.566395:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d3b expref: 3589 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.566396:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.566400:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d3b expref: 3589 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.566412:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8500/0xefc4487a01847bb2 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdb9 expref: 3518 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.566414:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d3b expref: 3589 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.566421:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584540160:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.566432:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098af3980/0xefc4487a01879ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d3b expref: 3589 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.566438:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af3980, rc 0) 00000100:00100000:3.0:1705683932.566455:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907acb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3589:4708:x1788538641079040:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1194us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.566460:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921249 00000100:00100000:0.0:1705683932.566469:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073483c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584540480:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.566487:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.566496:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.566510:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566511:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566515:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079552 00000100:00100000:3.0:1705683932.566526:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566527:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.566530:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921253 00000100:00100000:3.0:1705683932.566533:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:6496:x1788538641079552:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.566537:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.566538:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.566550:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566551:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566625:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079616 00000100:00100000:0.0:1705683932.566639:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.566639:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.566642:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.566643:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921254 00000100:00100000:0.0:1705683932.566647:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3518:16443:x1788538641079616:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.566650:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.566651:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.566652:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.566655:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079680 00000100:00100000:1.0:1705683932.566666:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921255 00000100:00100000:1.0:1705683932.566669:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5982:16415:x1788538641079680:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.566673:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.566835:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098af0a00/0xefc4487a01879bc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d57 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.566843:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.566849:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566850:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.566852:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af0a00/0xefc4487a01879bc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d57 expref: 4015 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.566857:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af0a00/0xefc4487a01879bc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d57 expref: 4015 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.566860:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af0a00, rc 0) 00000100:00100000:3.0:1705683932.566876:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:6496:x1788538641079552:12345-192.168.203.41@tcp:101:dd.0 Request processed in 343us (381us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.566878:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 2/0,0 mode: --/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d5e expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.566879:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921253 00010000:00010000:0.0:1705683932.566892:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3588 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.566901:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.566902:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.566904:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 4/0,0 mode: --/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d5e expref: 3519 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.566916:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3588 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.566922:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3588 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.566928:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d65 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.566929:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073484100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584540544:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.566939:0:15095:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4014 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.566944:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.566944:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1705683932.566945:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.566946:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d65 expref: 5983 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.566955:0:15095:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4014 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.566960:0:15095:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4014 pid: 15192 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.566966:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.566966:0:15095:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584540608:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.566979:0:15095:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.566987:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.566988:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.566991:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079744 00000100:00100000:1.0:1705683932.567003:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567004:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567004:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567005:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567007:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921256 00000100:00100000:1.0:1705683932.567010:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:7259:x1788538641079744:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.567014:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.567027:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584540416:192.168.203.41@tcp:104: 00000100:00100000:0.0:1705683932.567030:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073483c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584540480:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.567037:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d50 expref: 4015 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.567039:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.567045:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098af3480, rc 0) 00000100:00100000:0.0:1705683932.567050:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3519:1856:x1788538641079424:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 690us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.567054:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333193 00000100:00100000:3.0:1705683932.567060:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:6554:x1788538641079488:12345-192.168.203.41@tcp:101:dd.0 Request processed in 723us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.567084:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921252 00000100:00100000:0.0:1705683932.567102:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.567110:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.567111:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.567114:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079808 00010000:00010000:0.0:1705683932.567123:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4015 pid: 15175 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.567190:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.567191:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.567195:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333194 00000100:00100000:0.0:1705683932.567198:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:1857:x1788538641079808:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.567204:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.567211:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4015 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.567217:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4015 pid: 15175 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.567226:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ed400/0xefc4487a01879bdb lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9666:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d6c expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.567228:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a14bca00/0xefc4487a01863927 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9532:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3b6 expref: 4015 pid: 15175 timeout: 805 lvb_type: 1 00002000:00010000:1.0:1705683932.567234:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9666:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.567235:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.567236:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.567238:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d50 expref: 4015 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567241:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.567242:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.567243:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d50 expref: 4015 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567244:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ed400/0xefc4487a01879bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d6c expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567250:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ed400/0xefc4487a01879bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d6c expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567255:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ed400, rc 0) 00010000:00010000:0.0:1705683932.567257:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098af3480/0xefc4487a01879bbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d50 expref: 4015 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.567267:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540672:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.567267:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:7259:x1788538641079744:12345-192.168.203.41@tcp:101:dd.0 Request processed in 256us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.567271:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921256 00000100:00100000:0.0:1705683932.567283:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.567292:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.567342:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.567357:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567358:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567362:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079872 00000100:00100000:1.0:1705683932.567382:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567382:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567383:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567385:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567386:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641079936 00000100:00100000:3.0:1705683932.567391:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921257 00000100:00100000:3.0:1705683932.567394:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3519:6521:x1788538641079872:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.567398:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567399:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567401:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.567402:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.567403:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921258 00000100:00100000:1.0:1705683932.567406:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:4708:x1788538641079936:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.567409:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.567411:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.567466:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d7a expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567477:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.567485:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.567486:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.567487:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d7a expref: 4016 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567499:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.567505:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.567511:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041c600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584540736:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.567529:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.567576:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf2d00/0xefc4487a01879be9 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d73 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.567585:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.567591:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.567592:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.567594:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf2d00/0xefc4487a01879be9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d73 expref: 3520 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.567599:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf2d00/0xefc4487a01879be9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d73 expref: 3520 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.567603:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf2d00, rc 0) 00000100:00100000:3.0:1705683932.567617:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3520:6521:x1788538641079872:12345-192.168.203.41@tcp:101:dd.0 Request processed in 222us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.567620:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921257 00000100:00100000:1.0:1705683932.567755:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073484100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584540544:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.567767:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 3/0,0 mode: --/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d5e expref: 3519 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567775:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff9b80, rc 0) 00000100:00100000:1.0:1705683932.567788:0:15095:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15095:1788538584540608:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.567796:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d65 expref: 5983 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.567802:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ef700, rc 0) 00000100:00100000:1.0:1705683932.567819:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5983:16415:x1788538641079680:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1149us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.567824:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921255 00000100:00100000:0.0:1705683932.567836:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540672:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.567844:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3519:16443:x1788538641079616:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1196us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.567847:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921254 00000100:00100000:1.0:1705683932.568121:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.568138:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.568140:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.568155:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4016:1857:x1788538641079808:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 956us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.568157:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.568160:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333194 00000100:00100000:1.0:1705683932.568166:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.568169:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568170:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568172:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568173:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080000 00000100:00100000:1.0:1705683932.568173:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568176:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080064 00010000:00010000:0.0:1705683932.568180:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3589 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.568185:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4016 pid: 15192 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.568190:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568191:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568193:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080192 00000100:00100000:1.0:1705683932.568195:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568195:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568198:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333195 00010000:00010000:0.0:1705683932.568199:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.568200:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3589:1856:x1788538641080000:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.568205:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.568207:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3589 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.568209:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568209:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.568211:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3589 pid: 15133 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.568212:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333196 00000100:00100000:0.0:1705683932.568215:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4016:1856:x1788538641080064:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.568220:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.568220:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095106d00/0xefc4487a017fd33c lrc: 0/0,0 mode: --/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd3e expref: 3589 pid: 15133 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.568222:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4016 pid: 15192 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.568230:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568230:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.568231:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4016 pid: 15192 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.568232:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d5e expref: 3518 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.568236:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d5e expref: 3518 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.568241:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9df700/0xefc4487a01825d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db485 expref: 4016 pid: 15192 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.568248:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568248:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ff9b80/0xefc4487a01879bcd lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d5e expref: 3518 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.568249:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.568251:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d65 expref: 5983 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.568254:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584540800:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.568256:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d65 expref: 5983 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.568269:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958ef700/0xefc4487a01879bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d65 expref: 5983 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.568269:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.568275:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540864:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.568278:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568279:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568284:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333197 00000100:00100000:1.0:1705683932.568287:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5983:1857:x1788538641080192:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.568290:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.568292:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.568299:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.568305:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5983 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.568313:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568314:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568316:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d7a expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.568321:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d7a expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.568326:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.568333:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d7a expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.568338:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880090418a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584540928:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.568340:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.568353:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.568361:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568362:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568365:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080128 00000100:00100000:1.0:1705683932.568376:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568377:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568379:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080256 00000100:00100000:1.0:1705683932.568385:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568386:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.568386:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568390:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080320 00000100:00100000:1.0:1705683932.568396:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568397:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568399:0:15095:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080384 00000100:00100000:3.0:1705683932.568400:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.568402:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568406:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.568407:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568408:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.568409:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.568409:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921259 00000100:00100000:3.0:1705683932.568413:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6554:x1788538641080128:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.568414:0:15095:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921260 00000100:00100000:0.0:1705683932.568417:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921261 00000100:00100000:1.0:1705683932.568417:0:15095:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6496:x1788538641080256:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.568420:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073484b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5984:6521:x1788538641080320:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.568421:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.568423:0:15095:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.568424:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.568438:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d81 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.568450:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3592 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.568456:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.568457:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.568459:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d81 expref: 3592 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.568475:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3592 pid: 15114 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.568481:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3592 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.568489:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584540992:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.568516:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.568527:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.568528:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.568533:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921262 00000100:00100000:3.0:1705683932.568537:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073481400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:7259:x1788538641080384:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.568543:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.568589:0:15095:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ed680/0xefc4487a01879bf7 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d88 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.568603:0:15095:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.568610:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568611:0:15095:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.568613:0:15095:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ed680/0xefc4487a01879bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d88 expref: 3593 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.568619:0:15095:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ed680/0xefc4487a01879bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d88 expref: 3593 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.568624:0:15095:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ed680, rc 0) 00000100:00100000:1.0:1705683932.568636:0:15095:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:6496:x1788538641080256:12345-192.168.203.41@tcp:101:dd.0 Request processed in 219us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.568640:0:15095:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921260 00010000:00010000:1.0:1705683932.568658:0:15110:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bce4000/0xefc4487a01847bce lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc0 expref: 5984 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.568665:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041c600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584540736:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.568672:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958eef80/0xefc4487a01879be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d7a expref: 4015 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.568677:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958eef80, rc 0) 00000100:00100000:1.0:1705683932.568685:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041f300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:4708:x1788538641079936:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1279us (1344us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.568687:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ffa080/0xefc4487a01879bfe lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d8f expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.568688:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921258 00002000:00010000:0.0:1705683932.568699:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.568720:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.568721:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.568724:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ffa080/0xefc4487a01879bfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d8f expref: 5984 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.568732:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ffa080/0xefc4487a01879bfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d8f expref: 5984 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.568737:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffa080, rc 0) 00010000:00010000:3.0:1705683932.568739:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf3700/0xefc4487a01879c05 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d96 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.568750:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.568757:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.568758:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.568760:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf3700/0xefc4487a01879c05 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d96 expref: 3593 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.568765:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf3700/0xefc4487a01879c05 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d96 expref: 3593 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.568770:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf3700, rc 0) 00000100:00100000:3.0:1705683932.568819:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073481400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:7259:x1788538641080384:12345-192.168.203.41@tcp:101:dd.0 Request processed in 282us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.568821:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073484b00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5984:6521:x1788538641080320:12345-192.168.203.41@tcp:101:dd.0 Request processed in 398us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.568823:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921262 00000100:00100000:0.0:1705683932.568826:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921261 00000100:00100000:1.0:1705683932.568834:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584540800:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.568842:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.568853:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1856:x1788538641080000:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 652us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.568858:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333195 00000100:00100000:0.0:1705683932.568871:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880090418a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584540928:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.568881:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.568895:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5983:1857:x1788538641080192:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 607us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.568899:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333197 00000100:00100000:0.0:1705683932.568928:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073485000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584540864:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.568936:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.568947:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:1856:x1788538641080064:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 732us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.568954:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333196 00000100:00100000:3.0:1705683932.569179:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584540992:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.569191:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d81 expref: 3591 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569198:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf1400, rc 0) 00000100:00100000:3.0:1705683932.569223:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6554:x1788538641080128:12345-192.168.203.41@tcp:101:dd.0 Request processed in 809us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.569228:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921259 00000100:00100000:0.0:1705683932.569237:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.569253:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569254:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569258:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080576 00000100:00100000:3.0:1705683932.569269:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569269:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569272:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921263 00000100:00100000:0.0:1705683932.569274:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.569274:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073485000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5983:16443:x1788538641080576:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.569278:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.569286:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569287:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569291:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080512 00000100:00100000:0.0:1705683932.569299:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.569301:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3591 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.569309:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.569310:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569312:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569312:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.569314:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080448 00000100:00100000:1.0:1705683932.569315:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333198 00000100:00100000:1.0:1705683932.569318:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88013766c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:1857:x1788538641080512:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.569323:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1705683932.569325:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.569326:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.569329:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3591 pid: 15114 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.569330:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921264 00000100:00100000:0.0:1705683932.569333:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3519:16415:x1788538641080448:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.569335:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3591 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.569339:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.569345:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095964780/0xefc4487a0186393c lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3bd expref: 3591 pid: 15114 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.569352:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.569353:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.569355:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d81 expref: 3590 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.569361:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d81 expref: 3590 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.569374:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131cf1400/0xefc4487a01879bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d81 expref: 3590 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.569381:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584541056:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.569399:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c840 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.569414:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301da4 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569423:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4013 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569427:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.569427:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.569429:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301da4 expref: 5984 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569436:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4013 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569440:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4013 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.569445:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584541120:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.569461:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.569508:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301d9d expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.569512:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.569521:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3590 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.569523:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569524:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.569526:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1705683932.569527:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1705683932.569527:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080704 00010000:00010000:0.0:1705683932.569528:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d9d expref: 3520 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.569536:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.569536:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569537:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.569540:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921265 00010000:00010000:0.0:1705683932.569541:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3590 pid: 15173 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.569542:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3521:6521:x1788538641080704:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.569546:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.569547:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3590 pid: 15173 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.569547:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569548:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569552:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080640 00000100:00100000:0.0:1705683932.569559:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff880073485a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584541184:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.569563:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569564:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569567:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921266 00000100:00100000:1.0:1705683932.569570:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:4708:x1788538641080640:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.569575:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.569577:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.569764:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dab expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569765:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf1680/0xefc4487a01879c21 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301db2 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.569774:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.569777:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3521 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.569782:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.569782:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.569783:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.569784:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.569785:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dab expref: 3592 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569786:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf1680/0xefc4487a01879c21 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301db2 expref: 3522 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.569793:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf1680/0xefc4487a01879c21 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301db2 expref: 3522 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.569796:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.569798:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf1680, rc 0) 00010000:00010000:1.0:1705683932.569802:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.569808:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584541248:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.569812:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041c600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3522:6521:x1788538641080704:12345-192.168.203.41@tcp:101:dd.0 Request processed in 269us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.569817:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921265 00000100:00100000:1.0:1705683932.569823:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.569899:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.569909:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569910:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569914:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080768 00000100:00100000:1.0:1705683932.569929:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584541056:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.569937:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.569961:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88013766c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1857:x1788538641080512:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 643us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.569966:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333198 00000100:00100000:1.0:1705683932.569997:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.569998:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570002:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921267 00000100:00100000:1.0:1705683932.570005:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073487300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4014:6496:x1788538641080768:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.570010:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.570024:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584541120:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.570034:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301da4 expref: 5984 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.570037:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.570040:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf0c80, rc 0) 00000100:00100000:0.0:1705683932.570058:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.570059:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073485000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5984:16443:x1788538641080576:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 784us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.570064:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921263 00000100:00100000:3.0:1705683932.570088:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.570088:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.570091:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080832 00000100:00100000:3.0:1705683932.570099:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.570100:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.570102:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921268 00000100:00100000:3.0:1705683932.570104:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:6554:x1788538641080832:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.570108:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.570139:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dc0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.570147:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4016 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.570151:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.570152:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.570153:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc0 expref: 4016 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.570160:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4016 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.570163:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4016 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.570168:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584541312:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.570182:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.570223:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.570253:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570254:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570259:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080896 00010000:00010000:1.0:1705683932.570268:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4017 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.570279:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570280:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570282:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333199 00000100:00100000:1.0:1705683932.570285:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073480500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:1857:x1788538641080896:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.570290:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.570291:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4017 pid: 15095 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.570297:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4017 pid: 15095 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.570308:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081b35b80/0xefc4487a017fd779 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdd84 expref: 4017 pid: 15095 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.570316:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.570317:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.570319:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301da4 expref: 5983 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.570324:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301da4 expref: 5983 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.570338:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131cf0c80/0xefc4487a01879c0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301da4 expref: 5983 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.570349:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584541376:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.570350:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.570364:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.570372:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570373:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570377:0:15238:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081024 00010000:00010000:1.0:1705683932.570385:0:15238:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.570403:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570404:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570407:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333200 00000100:00100000:1.0:1705683932.570410:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073486e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3522:1857:x1788538641081024:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.570414:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.570421:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 5/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.570427:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.570437:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.570437:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.570439:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dab expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.570443:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dab expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.570458:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dab expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.570464:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584541440:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.570477:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.570479:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.570480:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.570485:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641080960 00010000:00010000:1.0:1705683932.570489:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ee580/0xefc4487a01879c2f lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301db9 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.570497:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1705683932.570504:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.570504:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.570505:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.570505:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.570507:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ee580/0xefc4487a01879c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301db9 expref: 4018 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.570509:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921269 00000100:00100000:0.0:1705683932.570511:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:7259:x1788538641080960:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.570512:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ee580/0xefc4487a01879c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301db9 expref: 4018 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.570517:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.570517:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ee580, rc 0) 00000100:00100000:1.0:1705683932.570528:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073487300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6496:x1788538641080768:12345-192.168.203.41@tcp:101:dd.0 Request processed in 523us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.570532:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921267 00010000:00010000:1.0:1705683932.570551:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdb8280/0xefc4487a01847bc7 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdc7 expref: 3522 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.570559:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584541248:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.570567:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ee800/0xefc4487a01879c1a lrc: 4/0,0 mode: PW/PW res: [0x280000403:0x1b30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dab expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.570572:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ee800, rc 0) 00000100:00100000:1.0:1705683932.570583:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:4708:x1788538641080640:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1012us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.570587:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921266 00010000:00010000:0.0:1705683932.570833:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ffb480/0xefc4487a01879c36 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9667:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dc7 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.570844:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9667:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.570852:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.570854:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.570857:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ffb480/0xefc4487a01879c36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc7 expref: 4018 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.570864:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ffb480/0xefc4487a01879c36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc7 expref: 4018 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.570875:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffb480, rc 0) 00000100:00100000:0.0:1705683932.570889:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073485f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:7259:x1788538641080960:12345-192.168.203.41@tcp:101:dd.0 Request processed in 377us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.570894:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921269 00000100:00100000:0.0:1705683932.570916:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff880073485a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584541184:192.168.203.41@tcp:104: 00010000:00010000:0.0:1705683932.570925:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d9d expref: 3521 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.570932:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff9180, rc 0) 00000100:00100000:0.0:1705683932.570945:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3521:16415:x1788538641080448:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1612us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.570949:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921264 00000100:00100000:0.0:1705683932.570984:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.570994:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.570995:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571000:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081088 00010000:00010000:1.0:1705683932.571009:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3591 pid: 15173 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.571019:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571019:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571022:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333201 00000100:00100000:1.0:1705683932.571024:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073485a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:1857:x1788538641081088:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.571028:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.571030:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3591 pid: 15173 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.571035:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3591 pid: 15173 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.571046:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013338e080/0xefc4487a01825fa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db503 expref: 3591 pid: 15173 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.571056:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.571056:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.571058:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d9d expref: 3520 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.571062:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d9d expref: 3520 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.571096:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099ff9180/0xefc4487a01879c13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301d9d expref: 3520 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.571102:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584541504:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.571116:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.571160:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.571170:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571170:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571174:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081152 00000100:00100000:0.0:1705683932.571185:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571186:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571190:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921270 00000100:00100000:0.0:1705683932.571192:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073486900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5984:6521:x1788538641081152:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.571198:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.571320:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ffa580/0xefc4487a01879c3d lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dce expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.571333:0:15147:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.571342:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.571343:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.571346:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ffa580/0xefc4487a01879c3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dce expref: 5985 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.571353:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ffa580/0xefc4487a01879c3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dce expref: 5985 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.571358:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffa580, rc 0) 00000100:00100000:0.0:1705683932.571375:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073486900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5985:6521:x1788538641081152:12345-192.168.203.41@tcp:101:dd.0 Request processed in 182us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.571380:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921270 00000100:00100000:0.0:1705683932.571437:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.571448:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571449:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571453:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081216 00000100:00100000:3.0:1705683932.571458:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:15148:1788538584541312:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.571462:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4018 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.571472:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.571472:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc0 expref: 4018 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.571473:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571474:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.571474:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571475:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333202 00000100:00100000:1.0:1705683932.571478:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:1857:x1788538641081216:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.571482:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1705683932.571482:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf2080, rc 0) 00010000:00010000:1.0:1705683932.571488:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4018 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.571499:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4018 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.571501:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6554:x1788538641080832:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1396us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.571505:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921268 00010000:00010000:1.0:1705683932.571509:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1025e00/0xefc4487a01863966 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9533:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e0 expref: 4018 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.571516:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.571517:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.571518:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc0 expref: 4016 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.571524:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc0 expref: 4016 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.571535:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131cf2080/0xefc4487a01879c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dc0 expref: 4016 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.571541:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041a800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584541568:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.571558:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.571729:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:15238:1788538584541440:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.571739:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.571753:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073486e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3520:1857:x1788538641081024:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1342us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.571758:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333200 00000100:00100000:1.0:1705683932.571776:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584541504:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.571784:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.571795:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073485a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:1857:x1788538641081088:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 770us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.571799:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333201 00000100:00100000:1.0:1705683932.571814:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584541376:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.571821:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.571831:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073480500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4016:1857:x1788538641080896:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1545us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.571835:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333199 00000100:00100000:0.0:1705683932.571855:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.571892:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.571893:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.571898:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081280 00000100:00100000:3.0:1705683932.571911:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.571912:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.571915:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921271 00000100:00100000:3.0:1705683932.571918:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073484100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3590:6496:x1788538641081280:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.571923:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.571937:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.571949:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571950:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571954:0:15147:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081344 00000100:00100000:1.0:1705683932.571964:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571965:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.571968:0:15147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921272 00000100:00100000:1.0:1705683932.571971:0:15147:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3520:16443:x1788538641081344:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.571976:0:15147:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.572146:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf1e00/0xefc4487a01879c44 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dd5 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.572158:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.572163:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041a800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584541568:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.572168:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.572169:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.572170:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.572172:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.572172:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf1e00/0xefc4487a01879c44 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dd5 expref: 3591 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.572179:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf1e00/0xefc4487a01879c44 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dd5 expref: 3591 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.572185:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf1e00, rc 0) 00000100:00100000:1.0:1705683932.572188:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:1857:x1788538641081216:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 708us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.572192:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333202 00000100:00100000:3.0:1705683932.572200:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073484100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6496:x1788538641081280:12345-192.168.203.41@tcp:101:dd.0 Request processed in 282us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.572205:0:15147:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 2/0,0 mode: --/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ddc expref: -99 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.572205:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921271 00010000:00010000:1.0:1705683932.572217:0:15147:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3590 pid: 15095 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.572226:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.572227:0:15147:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.572230:0:15147:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 4/0,0 mode: --/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ddc expref: 3521 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.572236:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.572237:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.572241:0:15147:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3590 pid: 15095 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.572242:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081408 00010000:00010000:1.0:1705683932.572248:0:15147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3590 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.572252:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.572253:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572255:0:15147:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584541632:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.572256:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921273 00000100:00100000:0.0:1705683932.572257:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.572259:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073486400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5985:16415:x1788538641081408:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.572265:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.572270:0:15147:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.572278:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572279:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572283:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081472 00000100:00100000:1.0:1705683932.572296:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572297:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572300:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921274 00000100:00100000:1.0:1705683932.572303:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073484600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4015:4708:x1788538641081472:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:0.0:1705683932.572308:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.572308:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.572365:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dea expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.572375:0:15110:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5985 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.572383:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.572383:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.572385:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dea expref: 4016 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.572396:0:15110:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5985 pid: 15223 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.572402:0:15110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5985 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.572409:0:15110:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584541696:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.572426:0:15110:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.572433:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572434:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572437:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081536 00000100:00100000:1.0:1705683932.572448:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572448:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.572451:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921275 00000100:00100000:1.0:1705683932.572454:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073481900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3591:6554:x1788538641081536:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.572459:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.572482:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301df1 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.572493:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.572500:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.572501:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.572502:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.572503:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df1 expref: 3592 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.572508:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.572508:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.572512:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081600 00010000:00010000:1.0:1705683932.572514:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.572514:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301de3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.572519:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.572525:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4016 pid: 15118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.572528:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584541760:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.572529:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.572529:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1705683932.572530:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.572531:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.572531:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301de3 expref: 5986 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.572534:0:15095:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.572535:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921276 00000100:00100000:1.0:1705683932.572535:0:15095:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.572539:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073480a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3522:6521:x1788538641081600:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.572540:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4016 pid: 15118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.572544:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4016 pid: 15118 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.572545:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.572549:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584541824:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.572552:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.572564:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.572925:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ffaa80/0xefc4487a01879c67 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301df8 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1705683932.572934:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.572941:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.572941:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.572943:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ffaa80/0xefc4487a01879c67 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df8 expref: 3523 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.572949:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ffaa80/0xefc4487a01879c67 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df8 expref: 3523 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.572953:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ffaa80, rc 0) 00000100:00100000:0.0:1705683932.572965:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073480a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3523:6521:x1788538641081600:12345-192.168.203.41@tcp:101:dd.0 Request processed in 426us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.572968:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921276 00000100:00100000:0.0:1705683932.572995:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.573024:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.573029:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573030:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573034:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081728 00010000:00010000:1.0:1705683932.573044:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3593 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.573054:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573054:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573056:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333203 00000100:00100000:1.0:1705683932.573059:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:1857:x1788538641081728:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1705683932.573061:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.573063:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.573065:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3593 pid: 15095 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.573084:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3593 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.573093:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.573094:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.573094:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.573095:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573097:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ddc expref: 3522 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.573099:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081664 00010000:00010000:1.0:1705683932.573101:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ddc expref: 3522 pid: 15147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.573107:0:15147:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e323700/0xefc4487a017fd971 lrc: 0/0,0 mode: --/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cddfb expref: 3594 pid: 15095 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.573110:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573111:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.573112:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ddc expref: 3522 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.573113:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081792 00000100:00100000:0.0:1705683932.573114:0:15147:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041a800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:15147:1788538584541632:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.573117:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584541888:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.573120:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.573121:0:15147:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ecc80/0xefc4487a01879c4b lrc: 5/0,0 mode: PW/PW res: [0x280000402:0x668b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ddc expref: 3522 pid: 15147 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.573121:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573125:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921277 00010000:00010000:0.0:1705683932.573126:0:15147:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ecc80, rc 0) 00000100:00100000:3.0:1705683932.573127:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880073483700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:7259:x1788538641081664:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.573132:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.573133:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.573135:0:15147:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3522:16443:x1788538641081344:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1164us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.573138:0:15147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921272 00000100:00100000:1.0:1705683932.573139:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573140:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.573144:0:15147:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.573144:0:15147:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573145:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921278 00000100:00100000:1.0:1705683932.573148:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:6496:x1788538641081792:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.573153:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.573345:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf1b80/0xefc4487a01879c6e lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301dff expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.573354:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.573360:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.573361:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.573363:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf1b80/0xefc4487a01879c6e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dff expref: 3594 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.573368:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf1b80/0xefc4487a01879c6e lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dff expref: 3594 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573370:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958ee300/0xefc4487a01879c75 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x922f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e06 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.573372:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf1b80, rc 0) 00002000:00010000:1.0:1705683932.573379:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x922f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.573386:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573387:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573390:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958ee300/0xefc4487a01879c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e06 expref: 4018 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.573393:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073483700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3594:7259:x1788538641081664:12345-192.168.203.41@tcp:101:dd.0 Request processed in 265us (397us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.573397:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958ee300/0xefc4487a01879c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x922f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e06 expref: 4018 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.573397:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921277 00010000:00010000:1.0:1705683932.573402:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ee300, rc 0) 00000100:00100000:1.0:1705683932.573416:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6496:x1788538641081792:12345-192.168.203.41@tcp:101:dd.0 Request processed in 267us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.573420:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921278 00000100:00100000:1.0:1705683932.573508:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584541760:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.573520:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df1 expref: 3593 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573528:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ef980, rc 0) 00000100:00100000:1.0:1705683932.573543:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073481900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:6554:x1788538641081536:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1088us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.573547:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921275 00000100:00100000:0.0:1705683932.573601:0:15110:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041cb00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_037:lustre-OST0001_UUID:15110:1788538584541696:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.573610:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041e900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584541888:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.573613:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 3/0,0 mode: --/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dea expref: 4017 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573617:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1705683932.573620:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958edb80, rc 0) 00000100:00100000:3.0:1705683932.573621:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584541824:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.573628:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1857:x1788538641081728:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 568us (604us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.573631:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301de3 expref: 5986 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.573632:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333203 00000100:00100000:0.0:1705683932.573635:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073484600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:4708:x1788538641081472:12345-192.168.203.41@tcp:101:dd.0 Request processed in 1331us (1381us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.573636:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf0780, rc 0) 00000100:00100000:0.0:1705683932.573640:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921274 00000100:00100000:3.0:1705683932.573647:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880073486400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5986:16415:x1788538641081408:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1388us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.573651:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921273 00000100:00100000:1.0:1705683932.573652:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.573657:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573658:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573661:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081920 00010000:00010000:1.0:1705683932.573667:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.573678:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.573679:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573679:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573684:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081856 00000100:00100000:0.0:1705683932.573688:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.573688:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5986 pid: 15223 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.573689:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.573694:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333204 00000100:00100000:1.0:1705683932.573696:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333205 00000100:00100000:0.0:1705683932.573698:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:1857:x1788538641081920:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.573698:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5986:1857:x1788538641081856:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.573701:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.573704:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.573706:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5986 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.573723:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5986 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.573734:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb8c80/0xefc4487a01847bdc lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdce expref: 5986 pid: 15223 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.573740:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573741:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573742:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dea expref: 4016 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573745:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dea expref: 4016 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573754:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958edb80/0xefc4487a01879c52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301dea expref: 4016 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.573759:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584541952:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.573770:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.573801:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.573809:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573810:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573813:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641081984 00010000:00010000:1.0:1705683932.573822:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4017 pid: 15118 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.573832:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573833:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.573836:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333206 00000100:00100000:1.0:1705683932.573838:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:1857:x1788538641081984:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.573841:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.573843:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.573845:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4017 pid: 15118 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.573848:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.573851:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4017 pid: 15118 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.573859:0:7678:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c021900/0xefc4487a01826241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db5e3 expref: 4017 pid: 15118 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.573860:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1027980/0xefc4487a0186396d lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3e7 expref: 3592 pid: 15169 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.573866:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.573867:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.573869:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df1 expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573869:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573870:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.573872:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301de3 expref: 5985 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.573875:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df1 expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573877:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301de3 expref: 5985 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.573887:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131cf0780/0xefc4487a01879c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301de3 expref: 5985 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.573890:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958ef980/0xefc4487a01879c59 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301df1 expref: 3591 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.573892:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584542016:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.573897:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e1900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584542080:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.573903:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.573914:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880083498cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.573921:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.573953:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573954:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573959:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082048 00000100:00100000:3.0:1705683932.573971:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573972:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.573975:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921279 00000100:00100000:3.0:1705683932.573979:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5986:16443:x1788538641082048:12345-192.168.203.41@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1705683932.573980:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.573985:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.574005:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574007:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574011:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082112 00000100:00100000:0.0:1705683932.574023:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574024:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574027:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921280 00000100:00100000:1.0:1705683932.574029:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574030:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5987:6521:x1788538641082112:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:1.0:1705683932.574030:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.574036:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.574196:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.574213:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e14 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.574216:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.574224:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.574224:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4016 pid: 14405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.574225:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.574227:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1705683932.574228:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082176 00010000:00010000:3.0:1705683932.574228:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.574229:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e14 expref: 5988 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.574238:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4017 pid: 14405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.574240:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574241:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574243:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082240 00010000:00010000:3.0:1705683932.574246:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4017 pid: 14405 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.574248:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ff8f00/0xefc4487a01879c83 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e0d expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.574251:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574251:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584542144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.574252:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574255:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921281 00000100:00100000:1.0:1705683932.574258:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:7259:x1788538641082176:12345-192.168.203.41@tcp:101:dd.0 00002000:00010000:0.0:1705683932.574263:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.574264:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.574268:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.574271:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.574272:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.574275:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ff8f00/0xefc4487a01879c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e0d expref: 5989 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574276:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574277:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574281:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921282 00010000:00010000:0.0:1705683932.574282:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ff8f00/0xefc4487a01879c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e0d expref: 5989 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574284:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:6496:x1788538641082240:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.574288:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ff8f00, rc 0) 00010000:00010000:3.0:1705683932.574289:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.574305:0:15110:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041b700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5989:6521:x1788538641082112:12345-192.168.203.41@tcp:101:dd.0 Request processed in 273us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.574310:0:15110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921280 00000100:00100000:1.0:1705683932.574487:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:14229:1788538584541952:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.574496:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.574508:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5988:1857:x1788538641081856:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 808us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.574511:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333205 00010000:00010000:3.0:1705683932.574512:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf2a80/0xefc4487a01879c8a lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e22 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.574524:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.574525:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7678:1788538584542016:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.574531:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.574532:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.574533:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.574536:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf2a80/0xefc4487a01879c8a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e22 expref: 3593 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.574539:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041ee00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:1857:x1788538641081984:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 700us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.574542:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333206 00010000:00010000:3.0:1705683932.574544:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf2a80/0xefc4487a01879c8a lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e22 expref: 3593 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.574549:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e1900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15194:1788538584542080:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.574549:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf2a80, rc 0) 00010000:00010000:1.0:1705683932.574552:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958eed00/0xefc4487a01879c91 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9668:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e1b expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.574559:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1705683932.574561:0:15192:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9668:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1705683932.574565:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090419400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:6496:x1788538641082240:12345-192.168.203.41@tcp:101:dd.0 Request processed in 280us (349us total) trans 0 rc 0/0 00010000:00010000:1.0:1705683932.574568:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.574569:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.574572:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958eed00/0xefc4487a01879c91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e1b expref: 4017 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574573:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921282 00000100:00100000:0.0:1705683932.574574:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:1857:x1788538641081920:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 875us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.574579:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333204 00010000:00010000:1.0:1705683932.574579:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958eed00/0xefc4487a01879c91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e1b expref: 4017 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.574584:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958eed00, rc 0) 00000100:00100000:1.0:1705683932.574596:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880090418500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:7259:x1788538641082176:12345-192.168.203.41@tcp:101:dd.0 Request processed in 337us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.574603:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921281 00000100:00100000:1.0:1705683932.574636:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.574646:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574646:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574650:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082304 00000100:00100000:1.0:1705683932.574660:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574660:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574663:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921283 00000100:00100000:1.0:1705683932.574666:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3522:16415:x1788538641082304:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.574671:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.574772:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.574800:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574801:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.574805:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.574805:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082368 00010000:00010000:1.0:1705683932.574806:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e29 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574816:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.574817:0:15135:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3592 pid: 15153 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574817:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574818:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082432 00010000:00010000:1.0:1705683932.574822:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.574823:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1705683932.574824:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e29 expref: 3523 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.574824:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574825:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.574828:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921284 00000100:00100000:3.0:1705683932.574830:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3592:4708:x1788538641082368:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.574834:0:15135:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3592 pid: 15153 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.574834:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.574839:0:15135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3592 pid: 15153 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.574845:0:15135:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584542208:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.574858:0:15135:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.574865:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574866:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.574870:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921285 00000100:00100000:1.0:1705683932.574873:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:6554:x1788538641082432:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.574878:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.574886:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e30 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.574896:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3523 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.574899:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.574900:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.574901:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e30 expref: 3593 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.574909:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e37 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.574909:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3523 pid: 15103 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.574913:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3523 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.574918:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.574922:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584542272:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.574923:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.574923:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.574925:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e37 expref: 4018 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.574934:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.574939:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.574940:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.574946:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584542336:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.574956:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14216:1788538584542144:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.574962:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.574967:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e14 expref: 5987 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.574974:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf2580, rc 0) 00000100:00100000:3.0:1705683932.575040:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041da00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5987:16443:x1788538641082048:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1060us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.575044:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921279 00000100:00100000:1.0:1705683932.575083:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.575103:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575104:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575109:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082496 00000100:00100000:1.0:1705683932.575115:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.575119:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4019 pid: 14405 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1705683932.575135:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575136:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575136:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575137:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575139:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333207 00000100:00100000:3.0:1705683932.575141:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082560 00000100:00100000:0.0:1705683932.575142:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4019:1856:x1788538641082496:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.575147:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.575149:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4019 pid: 14405 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.575150:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575150:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575153:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921286 00010000:00010000:0.0:1705683932.575155:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4019 pid: 14405 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.575155:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:6521:x1788538641082560:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.575160:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1705683932.575166:0:15194:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ec1900/0xefc4487a017fdc88 lrc: 0/0,0 mode: --/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cde41 expref: 4019 pid: 14405 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.575174:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.575175:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.575177:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e14 expref: 5986 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.575182:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e14 expref: 5986 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.575241:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7e080/0xefc4487a01879cad lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e3e expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.575250:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131cf2580/0xefc4487a01879c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e14 expref: 5986 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.575252:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.575259:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.575260:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1705683932.575262:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584542400:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.575263:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7e080/0xefc4487a01879cad lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e3e expref: 3525 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.575268:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098b7e080/0xefc4487a01879cad lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e3e expref: 3525 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.575272:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7e080, rc 0) 00000100:00100000:0.0:1705683932.575343:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.575344:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3525:6521:x1788538641082560:12345-192.168.203.41@tcp:101:dd.0 Request processed in 188us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.575347:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921286 00000100:00100000:1.0:1705683932.575432:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.575438:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575439:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575442:0:7678:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082624 00010000:00010000:1.0:1705683932.575449:0:7678:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3594 pid: 15153 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.575457:0:7678:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575458:0:7678:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575460:0:7678:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333208 00000100:00100000:1.0:1705683932.575463:0:7678:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3594:1856:x1788538641082624:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.575467:0:7678:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.575468:0:7678:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3594 pid: 15153 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.575473:0:7678:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3594 pid: 15153 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.575483:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.575484:0:7678:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.575486:0:7678:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e29 expref: 3524 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575490:0:7678:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e29 expref: 3524 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575502:0:7678:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e29 expref: 3524 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.575511:0:7678:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584542464:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.575524:0:7678:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.575538:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584542336:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.575549:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 3/0,0 mode: --/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e37 expref: 4018 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575553:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940ca800, rc 0) 00000100:00100000:1.0:1705683932.575562:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6554:x1788538641082432:12345-192.168.203.41@tcp:101:dd.0 Request processed in 689us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.575565:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921285 00010000:00010000:1.0:1705683932.575577:0:15135:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e97d680/0xefc4487a018264b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db68b expref: 3594 pid: 15153 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.575582:0:15135:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff88009041d000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_054:lustre-OST0000_UUID:15135:1788538584542208:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.575589:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958ec280/0xefc4487a01879c98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe5a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e29 expref: 3524 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575594:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958ec280, rc 0) 00000100:00100000:1.0:1705683932.575607:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:16415:x1788538641082304:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 940us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.575610:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.575611:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921283 00000100:00100000:3.0:1705683932.575611:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584542272:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.575621:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 3/0,0 mode: --/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e30 expref: 3593 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.575622:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575624:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575627:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082688 00010000:00010000:3.0:1705683932.575627:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131cf3c00, rc 0) 00010000:00010000:1.0:1705683932.575634:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1705683932.575638:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:4708:x1788538641082368:12345-192.168.203.41@tcp:101:dd.0 Request processed in 807us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.575639:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.575642:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921284 00000100:00100000:1.0:1705683932.575655:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575656:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575658:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.575659:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575659:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082752 00010000:00010000:1.0:1705683932.575664:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3524 pid: 15103 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.575665:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333209 00000100:00100000:0.0:1705683932.575668:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:1856:x1788538641082688:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1705683932.575672:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575673:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.575674:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1705683932.575675:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333210 00000100:00100000:1.0:1705683932.575678:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:1856:x1788538641082752:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.575681:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.575682:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.575686:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.575688:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3524 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.575693:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3524 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.575695:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01caa80/0xefc4487a01863974 lrc: 0/0,0 mode: --/PR res: [0x2c0000402:0x9534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3ee expref: 4018 pid: 15215 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.575701:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.575702:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.575702:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f9f200/0xefc4487a01847bf1 lrc: 0/0,0 mode: --/PR res: [0x280000403:0x1b31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdf1 expref: 3524 pid: 15103 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.575704:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e37 expref: 4017 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575719:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.575720:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.575721:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e37 expref: 4017 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575722:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 2/0,0 mode: PW/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e30 expref: 3592 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575730:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e30 expref: 3592 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.575739:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940ca800/0xefc4487a01879ca6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e37 expref: 4017 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.575743:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131cf3c00/0xefc4487a01879c9f lrc: 3/0,0 mode: PW/PW res: [0x280000403:0x1b31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e30 expref: 3592 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.575746:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584542528:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.575749:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584542592:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.575758:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.575764:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.575789:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.575841:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575842:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575846:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082816 00000100:00100000:1.0:1705683932.575864:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575865:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.575868:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921287 00000100:00100000:1.0:1705683932.575871:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff880133d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6496:x1788538641082816:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.575876:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.575888:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.575897:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575897:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575901:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082880 00000100:00100000:0.0:1705683932.575911:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584542400:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.575911:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575912:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.575914:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921288 00000100:00100000:3.0:1705683932.575916:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:7259:x1788538641082880:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1705683932.575918:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.575920:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.575927:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041e900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:1856:x1788538641082496:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 785us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.575930:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333207 00010000:00010000:1.0:1705683932.576104:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b80/0xefc4487a01879cb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e45 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.576114:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.576121:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.576122:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.576125:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b80/0xefc4487a01879cb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e45 expref: 4018 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576128:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7f200/0xefc4487a01879cbb lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e4c expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.576131:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b80/0xefc4487a01879cb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e45 expref: 4018 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.576136:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c9b80, rc 0) 00002000:00010000:3.0:1705683932.576143:0:15148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.576151:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.576152:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1705683932.576153:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff880133d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4018:6496:x1788538641082816:12345-192.168.203.41@tcp:101:dd.0 Request processed in 281us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.576155:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7f200/0xefc4487a01879cbb lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e4c expref: 3594 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.576157:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921287 00010000:00010000:3.0:1705683932.576162:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098b7f200/0xefc4487a01879cbb lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e4c expref: 3594 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576168:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7f200, rc 0) 00000100:00100000:3.0:1705683932.576184:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e2800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3594:7259:x1788538641082880:12345-192.168.203.41@tcp:101:dd.0 Request processed in 266us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.576189:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921288 00000100:00100000:0.0:1705683932.576208:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.576226:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576227:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576231:0:15148:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641082944 00000100:00100000:3.0:1705683932.576242:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576243:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576245:0:15148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921289 00000100:00100000:3.0:1705683932.576247:0:15148:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:16443:x1788538641082944:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1705683932.576251:0:15148:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.576310:0:7678:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7678:1788538584542464:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.576320:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.576320:0:7678:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.576336:0:7678:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff88009041a800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:1856:x1788538641082624:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 872us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.576341:0:7678:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333208 00000100:00100000:0.0:1705683932.576345:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e4600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8819:1788538584542528:192.168.203.41@tcp:105: 00010000:00010000:0.0:1705683932.576352:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.576355:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.576356:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.576359:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:1856:x1788538641082688:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 691us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.576359:0:15135:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083008 00000100:00100000:0.0:1705683932.576362:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333209 00000100:00100000:1.0:1705683932.576370:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.576370:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.576374:0:15135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921290 00000100:00100000:1.0:1705683932.576376:0:15135:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5987:6521:x1788538641083008:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.576382:0:15135:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.576386:0:15148:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e53 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576395:0:15148:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3592 pid: 8804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576401:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.576401:0:15148:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.576403:0:15148:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e53 expref: 3525 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576411:0:15148:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3592 pid: 8804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576415:0:15148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3592 pid: 8804 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.576420:0:15148:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584542656:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.576434:0:15148:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009de7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.576441:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.576448:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576448:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576451:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083072 00000100:00100000:3.0:1705683932.576458:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576459:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576461:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921291 00000100:00100000:3.0:1705683932.576463:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:6554:x1788538641083072:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.576466:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.576481:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e61 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.576485:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584542592:192.168.203.41@tcp:105: 00010000:00010000:3.0:1705683932.576489:0:14216:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 2/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3594 pid: 14281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.576493:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1705683932.576494:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.576495:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.576496:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 4/0,0 mode: --/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e61 expref: 3594 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576503:0:14216:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3594 pid: 14281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1705683932.576505:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3525:1856:x1788538641082752:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 825us (866us total) trans 0 rc 0/0 00010000:00010000:3.0:1705683932.576507:0:14216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3594 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.576509:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333210 00000100:00100000:3.0:1705683932.576511:0:14216:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584542720:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.576521:0:15135:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c8500/0xefc4487a01879cd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e5a expref: -99 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.576522:0:14216:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1705683932.576528:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00002000:00010000:1.0:1705683932.576532:0:15135:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.576538:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.576539:0:15135:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.576542:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576543:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576546:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083136 00010000:00010000:1.0:1705683932.576552:0:15135:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c8500/0xefc4487a01879cd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e5a expref: 5988 pid: 15135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.576554:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576554:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576556:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921292 00000100:00100000:3.0:1705683932.576558:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5989:16415:x1788538641083136:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.576559:0:15135:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c8500/0xefc4487a01879cd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e5a expref: 5989 pid: 15135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576562:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.576564:0:15135:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c8500, rc 0) 00000100:00100000:1.0:1705683932.576577:0:15135:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5989:6521:x1788538641083008:12345-192.168.203.41@tcp:101:dd.0 Request processed in 200us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.576581:0:15135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921290 00000100:00100000:0.0:1705683932.576769:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.576773:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e68 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576783:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4016 pid: 15162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.576789:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.576790:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.576791:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e68 expref: 5989 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.576799:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.576799:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4016 pid: 15162 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.576800:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.576803:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4016 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.576805:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083200 00000100:00100000:3.0:1705683932.576807:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584542784:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.576818:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.576819:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.576819:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.576819:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576822:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013135d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.576823:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921293 00000100:00100000:1.0:1705683932.576826:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4017:4708:x1788538641083200:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.576831:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.576899:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 2/0,0 mode: --/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e6f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.576911:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5989 pid: 14281 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1705683932.576914:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.576919:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.576920:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.576922:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 4/0,0 mode: --/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e6f expref: 4018 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.576930:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576931:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.576933:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5989 pid: 14281 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.576936:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083264 00010000:00010000:1.0:1705683932.576939:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5989 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.576946:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584542848:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.576947:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576948:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.576949:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.576950:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.576951:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921294 00000100:00100000:3.0:1705683932.576953:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3595:6496:x1788538641083264:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.576957:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.576965:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c540 going to sleep for 11 seconds 00010000:00010000:3.0:1705683932.577164:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7d680/0xefc4487a01879ce5 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x83b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e76 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.577172:0:15133:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x83b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.577179:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.577180:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.577182:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7d680/0xefc4487a01879ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e76 expref: 3596 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577186:0:15133:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098b7d680/0xefc4487a01879ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x83b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e76 expref: 3596 pid: 15133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577190:0:15133:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7d680, rc 0) 00000100:00100000:3.0:1705683932.577211:0:15133:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3596:6496:x1788538641083264:12345-192.168.203.41@tcp:101:dd.0 Request processed in 258us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.577214:0:15133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921294 00000100:00100000:3.0:1705683932.577232:0:15148:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae400 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:15148:1788538584542656:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.577243:0:15148:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e53 expref: 3524 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577250:0:15148:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7fc00, rc 0) 00000100:00100000:3.0:1705683932.577261:0:15148:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:16443:x1788538641082944:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1012us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.577265:0:15148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921289 00000100:00100000:3.0:1705683932.577286:0:14216:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14216:1788538584542720:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.577296:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 3/0,0 mode: --/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e61 expref: 3595 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577302:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7d400, rc 0) 00000100:00100000:0.0:1705683932.577315:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.577321:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3595:6554:x1788538641083072:12345-192.168.203.41@tcp:101:dd.0 Request processed in 857us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.577325:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577326:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577328:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921291 00000100:00100000:1.0:1705683932.577331:0:14229:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083392 00010000:00010000:1.0:1705683932.577341:0:14229:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3595 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.577345:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.577351:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577352:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577353:0:14229:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577353:0:14229:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577355:0:8819:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083328 00000100:00100000:1.0:1705683932.577356:0:14229:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333211 00000100:00100000:1.0:1705683932.577359:0:14229:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3595:1856:x1788538641083392:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.577363:0:14229:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1705683932.577370:0:14229:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 4/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3595 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.577379:0:14229:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 3/0,0 mode: PR/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3595 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.577389:0:14229:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xefc4487a01863989 lrc: 0/0,0 mode: --/PR res: [0x280000402:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb3f5 expref: 3595 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1705683932.577395:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.577396:0:14229:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.577397:0:14229:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e61 expref: 3594 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.577402:0:14229:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e61 expref: 3594 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.577413:0:8819:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3595 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1705683932.577415:0:14229:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098b7d400/0xefc4487a01879cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e61 expref: 3595 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.577421:0:14229:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584542912:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.577422:0:8819:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577422:0:8819:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577424:0:8819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333212 00000100:00100000:0.0:1705683932.577426:0:8819:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3595:1857:x1788538641083328:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.577430:0:8819:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.577432:0:8819:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 4/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3595 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.577435:0:8819:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3595 pid: 8804 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.577440:0:14229:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013258c600 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.577443:0:8819:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2acc80/0xefc4487a017fe1ac lrc: 0/0,0 mode: --/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdec6 expref: 3595 pid: 8804 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.577448:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.577449:0:8819:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.577450:0:8819:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e53 expref: 3523 pid: 15148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.577456:0:8819:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e53 expref: 3523 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.577463:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1705683932.577465:0:8819:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098b7fc00/0xefc4487a01879cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x668c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e53 expref: 3523 pid: 15148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.577469:0:8819:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584542976:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.577479:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577480:0:8819:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9e000 going to sleep for 11 seconds 00000100:00100000:3.0:1705683932.577480:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577484:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083456 00000100:00100000:3.0:1705683932.577496:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577497:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577500:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921295 00000100:00100000:3.0:1705683932.577503:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4019:7259:x1788538641083456:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.577509:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1705683932.577567:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1705683932.577582:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.577596:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577597:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577599:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1705683932.577603:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083584 00010000:00010000:1.0:1705683932.577614:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4020 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.577628:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577629:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577631:0:15194:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083648 00000100:00100000:0.0:1705683932.577632:0:15238:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577632:0:15238:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577636:0:15238:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333213 00010000:00010000:1.0:1705683932.577637:0:15194:0:(ldlm_lockd.c:2702:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5990 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1705683932.577638:0:15238:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4020:1857:x1788538641083584:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1705683932.577643:0:15238:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.577644:0:15238:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4020 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.577646:0:15194:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577646:0:15194:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:0.0:1705683932.577649:0:15238:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4020 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1705683932.577649:0:15194:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333214 00000100:00100000:1.0:1705683932.577651:0:15194:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5990:1857:x1788538641083648:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1705683932.577656:0:15194:0:(ldlm_lockd.c:1788:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1705683932.577657:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.577657:0:15238:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.577659:0:15238:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e68 expref: 5990 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.577662:0:15194:0:(ldlm_lockd.c:1833:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 5/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5990 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.577663:0:15238:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e68 expref: 5990 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.577668:0:15194:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5990 pid: 14281 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.577671:0:15238:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e68 expref: 5990 pid: 15192 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.577675:0:15238:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e3200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584543040:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.577678:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.577679:0:15194:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.577681:0:15194:0:(ldlm_lock.c:705:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 3/0,0 mode: PW/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e6f expref: 4020 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.577686:0:15194:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e6f expref: 4020 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.577687:0:15238:0:(client.c:2536:ptlrpc_set_wait()) set ffff88009bd9ed80 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.577700:0:15194:0:(ldlm_lockd.c:1132:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e6f expref: 4020 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.577706:0:15194:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e7300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584543104:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.577738:0:15194:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00010000:00010000:1.0:1705683932.577756:0:15169:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133c8aa80/0xefc4487a01847c4c lrc: 0/0,0 mode: --/PR res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ecdff expref: 5990 pid: 14281 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1705683932.577764:0:15169:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584542848:192.168.203.41@tcp:104: 00010000:00010000:1.0:1705683932.577774:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c8000/0xefc4487a01879cde lrc: 4/0,0 mode: PW/PW res: [0x2c0000403:0x1b6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e6f expref: 4020 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.577779:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c8000, rc 0) 00000100:00100000:1.0:1705683932.577795:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e3700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4020:4708:x1788538641083200:12345-192.168.203.41@tcp:101:dd.0 Request processed in 967us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.577799:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921293 00000100:00100000:1.0:1705683932.577808:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577809:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577812:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083520 00000100:00100000:1.0:1705683932.577821:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577821:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.577824:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921296 00000100:00100000:1.0:1705683932.577826:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3524:6521:x1788538641083520:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1705683932.577832:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.577834:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098b7ef80/0xefc4487a01879cec lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9669:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e7d expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1705683932.577846:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9669:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1705683932.577854:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.577855:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.577858:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b7ef80/0xefc4487a01879cec lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e7d expref: 4020 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577865:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098b7ef80/0xefc4487a01879cec lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e7d expref: 4020 pid: 14216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.577869:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7ef80, rc 0) 00000100:00100000:0.0:1705683932.577876:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.577885:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4020:7259:x1788538641083456:12345-192.168.203.41@tcp:101:dd.0 Request processed in 381us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.577888:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921295 00000100:00100000:3.0:1705683932.577894:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577894:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577897:0:14216:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083712 00000100:00100000:3.0:1705683932.577904:0:14216:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577905:0:14216:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577906:0:15135:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.577906:0:15135:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.577907:0:14216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921297 00000100:00100000:3.0:1705683932.577909:0:14216:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4020:6496:x1788538641083712:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.577915:0:14216:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1705683932.578006:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940cb700/0xefc4487a01879cf3 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x84d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e84 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1705683932.578015:0:15169:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x84d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1705683932.578023:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.578024:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1705683932.578026:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940cb700/0xefc4487a01879cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e84 expref: 3525 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.578032:0:15169:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940cb700/0xefc4487a01879cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x84d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e84 expref: 3525 pid: 15169 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1705683932.578037:0:15169:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940cb700, rc 0) 00000100:00100000:1.0:1705683932.578051:0:15169:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:7ca6da02-20b6-4f42-8e9b-19cc6057f377+3525:6521:x1788538641083520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 224us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.578055:0:15169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921296 00000100:00100000:1.0:1705683932.578136:0:14229:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e6900 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:14229:1788538584542912:192.168.203.41@tcp:105: 00010000:00010000:1.0:1705683932.578145:0:14229:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.578158:0:14229:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4b00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3594:1856:x1788538641083392:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 799us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.578162:0:14229:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333211 00000100:00100000:1.0:1705683932.578195:0:8819:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e5f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8819:1788538584542976:192.168.203.41@tcp:105: 00000100:00100000:0.0:1705683932.578199:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.578203:0:8819:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1705683932.578214:0:15238:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800947e3200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:15238:1788538584543040:192.168.203.41@tcp:105: 00000100:00100000:1.0:1705683932.578218:0:8819:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:1857:x1788538641083328:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 790us (872us total) trans 0 rc 0/0 00010000:00010000:0.0:1705683932.578221:0:15238:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.578222:0:8819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333212 00000100:00100000:0.0:1705683932.578229:0:15238:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4020:1857:x1788538641083584:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 590us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1705683932.578232:0:15238:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333213 00010000:00010000:3.0:1705683932.578236:0:14216:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098b7c780/0xefc4487a01879cfa lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e8b expref: -99 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.578244:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.578245:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00002000:00010000:3.0:1705683932.578246:0:14216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000402:0x9231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1705683932.578249:0:15169:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083776 00010000:00010000:3.0:1705683932.578253:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.578253:0:14216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.578256:0:14216:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b7c780/0xefc4487a01879cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e8b expref: 4021 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.578258:0:15169:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.578259:0:15169:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.578260:0:14216:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098b7c780/0xefc4487a01879cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x9231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e8b expref: 4021 pid: 14216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1705683932.578262:0:15169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921298 00010000:00010000:3.0:1705683932.578264:0:14216:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7c780, rc 0) 00000100:00100000:1.0:1705683932.578267:0:15169:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4021:6554:x1788538641083776:12345-192.168.203.41@tcp:101:dd.0 00000100:00100000:3.0:1705683932.578280:0:14216:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e1400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+4021:6496:x1788538641083712:12345-192.168.203.41@tcp:101:dd.0 Request processed in 369us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.578281:0:15194:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800934e7300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15194:1788538584543104:192.168.203.41@tcp:105: 00000100:00100000:3.0:1705683932.578285:0:14216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921297 00010000:00010000:1.0:1705683932.578289:0:15194:0:(ldlm_lockd.c:1846:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1705683932.578304:0:15194:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5989:1857:x1788538641083648:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 651us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1705683932.578308:0:15194:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333214 00010000:00010000:3.0:1705683932.578310:0:15192:0:(ldlm_lock.c:217:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007373e300/0xefc4487a01826718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2db725 expref: 4020 pid: 15162 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1705683932.578319:0:15192:0:(client.c:2255:ptlrpc_check_set()) Completed RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:15192:1788538584542784:192.168.203.41@tcp:104: 00010000:00010000:3.0:1705683932.578330:0:15192:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098b7db80/0xefc4487a01879cd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe5d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e68 expref: 5988 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.578340:0:15192:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098b7db80, rc 0) 00010000:00010000:1.0:1705683932.578345:0:15169:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.578356:0:15192:0:(service.c:2382:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5988:16415:x1788538641083136:12345-192.168.203.41@tcp:101:dir_create.sh.0 Request processed in 1796us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1705683932.578360:0:15192:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 921292 00010000:00010000:1.0:1705683932.578378:0:15169:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c8c80/0xefc4487a01879d01 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x9535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e92 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.578382:0:3074:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:1.0:1705683932.578390:0:15169:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099bc6580/0xefc4487a01863a62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000402:0x9535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb43b expref: 4020 pid: 15216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1705683932.578394:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.578394:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.578395:0:15169:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1705683932.578395:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.578396:0:15169:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c8c80/0xefc4487a01879d01 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x9535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e92 expref: 4020 pid: 15169 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.578399:0:15133:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083840 00000100:00100000:3.0:1705683932.578407:0:15133:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.578408:0:15133:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:1.0:1705683932.578409:0:15169:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099bc6580/0xefc4487a01863a62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000402:0x9535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb43b expref: 4020 pid: 15216 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1705683932.578411:0:15133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921299 00000100:00100000:3.0:1705683932.578413:0:15133:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e3200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_052:7ca6da02-20b6-4f42-8e9b-19cc6057f377+5988:16443:x1788538641083840:12345-192.168.203.41@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1705683932.578414:0:15169:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099bc6580/0xefc4487a01863a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000402:0x9535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2fb43b expref: 4020 pid: 15216 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1705683932.578418:0:15133:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1705683932.578421:0:15169:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800934e7300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:15169:1788538584543168:192.168.203.41@tcp:104: 00000100:00100000:1.0:1705683932.578437:0:15169:0:(client.c:2536:ptlrpc_set_wait()) set ffff880085c39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.578483:0:3075:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:3.0:1705683932.578484:0:15133:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098b7cc80/0xefc4487a01879d08 lrc: 2/0,0 mode: --/PW res: [0x2c0000402:0x734d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301e99 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.578495:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.578496:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.578496:0:15133:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5eea80/0xefc4487a017fe2cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000402:0x734d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdf13 expref: 4020 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.578501:0:15110:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083904 00010000:00010000:3.0:1705683932.578501:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.578502:0:15133:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1705683932.578503:0:15133:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b7cc80/0xefc4487a01879d08 lrc: 4/0,0 mode: --/PW res: [0x2c0000402:0x734d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301e99 expref: 5989 pid: 15133 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.578515:0:15110:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00010000:00010000:3.0:1705683932.578515:0:15133:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5eea80/0xefc4487a017fe2cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000402:0x734d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdf13 expref: 4020 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1705683932.578516:0:15110:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.578520:0:15110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921300 00000100:00100000:1.0:1705683932.578520:0:15148:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:1.0:1705683932.578521:0:15148:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:0.0:1705683932.578523:0:15110:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e6900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_037:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3593:7259:x1788538641083904:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.578525:0:15133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a5eea80/0xefc4487a017fe2cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000402:0x734d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2cdf13 expref: 4020 pid: 14234 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1705683932.578529:0:15110:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1705683932.578533:0:15133:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ac600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_052:lustre-OST0001_UUID:15133:1788538584543232:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.578553:0:15133:0:(client.c:2536:ptlrpc_set_wait()) set ffff88013135d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1705683932.578747:0:3076:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1705683932.578762:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.578763:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.578767:0:15192:0:(service.c:2160:ptlrpc_server_handle_req_in()) got req x1788538641083968 00000100:00100000:3.0:1705683932.578779:0:15192:0:(service.c:3700:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.578779:0:15192:0:(service.c:3701:ptlrpc_server_get_timeout()) NULL obd 00000100:00100000:3.0:1705683932.578782:0:15192:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 921301 00000100:00100000:3.0:1705683932.578785:0:15192:0:(service.c:2333:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:4e4c2945-9f4f-4fb6-9962-c1c561a1da28+3594:4708:x1788538641083968:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1705683932.578790:0:15192:0:(ldlm_lockd.c:1314:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1705683932.578851:0:15192:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b7c280/0xefc4487a01879d0f lrc: 2/0,0 mode: --/PW res: [0x280000403:0x1b32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ea7 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.578861:0:15192:0:(ldlm_lock.c:676:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098b4d680/0xefc4487a01847d25 lrc: 2/0,0 mode: PR/PR res: [0x280000403:0x1b32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ece37 expref: 3524 pid: 15132 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1705683932.578866:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.578867:0:15192:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.578868:0:15192:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b7c280/0xefc4487a01879d0f lrc: 4/0,0 mode: --/PW res: [0x280000403:0x1b32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ea7 expref: 3595 pid: 15192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.578871:0:15110:0:(ldlm_lockd.c:1386:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130d4ea80/0xefc4487a01879d16 lrc: 2/0,0 mode: --/PW res: [0x280000402:0x8728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd085a9447f301ea0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1705683932.578878:0:15192:0:(ldlm_lockd.c:1014:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098b4d680/0xefc4487a01847d25 lrc: 3/0,0 mode: PR/PR res: [0x280000403:0x1b32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ece37 expref: 3524 pid: 15132 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1705683932.578879:0:15110:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000402:0x8728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1705683932.578885:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1705683932.578886:0:15110:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1705683932.578887:0:15192:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098b4d680/0xefc4487a01847d25 lrc: 4/0,0 mode: PR/PR res: [0x280000403:0x1b32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0xd085a9447f2ece37 expref: 3524 pid: 15132 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1705683932.578888:0:15110:0:(ldlm_resource.c:1660:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130d4ea80/0xefc4487a01879d16 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ea0 expref: 3596 pid: 15110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1705683932.578894:0:15192:0:(client.c:1773:ptlrpc_send_new_req()) Sending RPC req@ffff8800907ae900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:15192:1788538584543296:192.168.203.41@tcp:104: 00000100:00100000:3.0:1705683932.578917:0:15192:0:(client.c:2536:ptlrpc_set_wait()) set ffff8801354a6000 going to sleep for 11 seconds 00010000:00010000:0.0:1705683932.578983:0:15110:0:(ldlm_lockd.c:1554:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130d4ea80/0xefc4487a01879d16 lrc: 3/0,0 mode: PW/PW res: [0x280000402:0x8728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0xd085a9447f301ea0 expref: 3596 pid: 15110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1705683932.578991:0:15110:0:(ldlm_lockd.c:1631:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d4ea80, rc 0) Debug log: 30566 lines, 30566 kept, 0 dropped, 0 bad.